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ABSTRACT 

Besearch vas conducted to develop the Police Career 
Index (PCI) and the regional assessment center exercises to provide a 
total personnel evaluation system to help police departments screen 
^applicants, evaluate on-the-job performance of of ficers eligible for 
/"promotion, and gauge a person's suitability for police work. . The PCI 
is based on actual performance criteria developed through cooperation 
with police officials in nine cities throughout the country. It 
measures how well an individual might handle four different police 
jobs—patrol officer, patrol sergeant, investigator-detective, and 
mid- level commander. This easily administered, objectively scored 
written test screens out high-risk applicants. . Those who register 
borderline scores are referred to a regional assessment center where 
a series of police job simulations elicit behavioral indicators of 
potential for success in various aspects of police work. . local 
departments may wish to consider the 2- fold system, tested with good 
results in several cities. About half of this report consists of 
description of the research to develop and validate the PCI and the 
assessment center exercises. Appendixes include job description 
booklets for precinct patrolman, investigative personnel, sergeants, 
and intermediate commanders (about 50 pages) . .The remainder is 
research data tables. , (TA) 
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FOREWORD 



Selecting the right person for the job is never easy. For police departments, it's 
particularly difficult. Enforcing the law is a complex, sensitive task that makes great 
demands on the individual officer. 

Because the stakes are so high, police departments have turned increasingly to a variety 
of tCots to help them screen applicants and evaluate on-the-job performance of officers 
eligible for promotion. At the saiiie time, police personnel experts have emphasized the 
need to develop moi^ reliable methods for gauging a person's suitability for police work. 
One new approach developed and tested with Institute support is described in this report. 

The research produced a Police Career Index based on actual performance criteria that 
measures how well an individual might handle fout different police jobs — patrol officer, 
patrol sergeant, investigator-detective, and mid-level commander. This easily adminis- 
tered written test screens out high-risk applicants. Those who register borderline scores 
are referred to a Regional Assessment Center for rigorous psychological evaluation. 

The two-fold procedure was tested with good resuUs in several cities. Local depart- 
ments may wish to consider the proposed system for use in improving their personnel 
decisions. 

Gerald M. Caplan, 
Director 

National Institute of Law Enforcement 
and Criminal Justice 
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EXECUTIVE SUMMARY 



A. Projtct Obiectives 

Our major objective in this research program has been 
to develop new methods for evaluating persons who 
apply for positions in ][)olice work and for assessing the 
potential of present police officers who are being consid- 
ered for promotion. 

In order to accomplish this central objective, an impor- 
tant secondary objective was to learn as fully as possible 
exactly what activities or job behaviors are critical to 
effectiveness and ineffectiveness (succ^s or failure) in. 
police woric. Thus, a first step in the research program 
involved studying the critical features of four different 
police jobs: general patrol officer, patrol sergeant, 
investigator/detective, and the intermediate command 
function. Defining these critical dimensions of job per- 
formance for each of these four police functions was 
used in two distinct ways to accomplish the central objec- 
tive of developing new assessment methods for police 
jobs: 

• First, the critical dimensions of police performance 
were used to design new methods of rating the job 
performance of police officers in the four police 
functions mentioned above. These rating methods 
were used to evaluate the current job performance 
effectiveness of police officers in order to conduct a 
concurrent validation study toward the end of con- 
structing a short, easily administered inventory with 
separate scoring keys shown empirically to be re- 
lated to different levels of performance effective- 
ness in those four functions. 

• Second, the critical dimensions of police perform- 
ance were the basis for designing simulations and 
stendardized situational tasks for use in evaluating 
candidates being considered for placement in any of 
the four police functions. In effect, these "work 
samples'"" or job simulations were designed to be 
used in assessment centers whe;e the success poten- 
tial of candidates for various policy jobs can be 
evaluated behaviorally. 

In essence, then, the central objective of this research 
was to develop two quite different but complementary 
procedures for evaluating candidates for any of four 
police jobs. One, which came to be called the POLICE 
CAREER INDEX, consists of a brief, easily adminis- 
tered and objectively scored inventory to be used in 
preliminary screening of applicants and candidates for 
police jobs. The other procedure, the Regional Assess- 
mcnt Center, consists of a series of police job simula- 
tions tailor-made to elicit behavioral indicators of a per- 
son's potential for success in various aspects of police 
woric. The intention is that these assessnnent centers will 



be available on a regional basis for use in evaluating 
career potential, strengths and weaknesses, and training 
or development needs for police job candidates and for 
currently employed police officers. 

B. Project Tasks and Methods 

Development of the POLICE CAREER INDEX was 
accomplished with^the cooperation of police officials in 
nine cities located throughout, the country. Job perform- 
ance ratings were obtained for police officers from each 
city. In addition, most of the persons who were rated also 
completed a comprehensive experimental battery of tests 
and inventories. Police officers participating in these 
activities did so, for the most part, on off-duty tinie, and 
they were reimbursed for their time. The numbers of 
officers for whom tests and ratings were finally available 
are shown below according to city: 





Completed Tests 


Job Performance 




and Inventories 


Ratings Available 


Albuquerque 


is 


18 


Cincinnati 


294 


315 


Des Moines . 


201 


218 


Miami (Dade Co.) 


239 


277 


Minneiq;>olis 


309 


.360 


Portland, Oregon 


169 


244 


San Diego 


140 


140 


Tucson 


28 


28 


Washington, D. C. 


419 


404 


Totals 


1.817 


2,004 



After discarding materials which were incomplete or 
improperly filled in, complete responses and perform- 
ance ratings were available for 700 patrol officers, ^415* 
detectives, 362 sergeants, and 206 middle conmiand 
officers Gieutenants and captains). 

A variety of statistical methods of analysis was used to 
examine the dimensionality of the performance ratings 
and to idendfy patterns of responses to test and inventory 
items which were most highly correlated with various 
performance ratings. A Monte Carlo method of item 
analysis and scoring key development v/as used to select 
scoring keys most likely to yield stable validity coeffi- 
cients. These methods were applied separately to each of 
the four police ftinctions in developing POLICE 
CAREER INDEX keys. Afler scoring-keys had been 
developed, their validities were examined separately ac- 
cording to subgroupings based on city, race, and sex. 

Development of simulations to be used in the Regional 
Assessment Center program was carried out over a series 
of steps directed toward continual examination, modifi- 
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cation, and finer and fine-tuning of the standardized 
exercises to be used in each of the four police assessment 
centers. These steps are listed and briefly described in the 
following: 

• Intensive study of critical performance dimensions 
for each police function was supplemented with 
firsthand observations by our staff members of 
officers as they carried out their jobs. Staff mem- 
bers developed a total of 55 preliminary job simula- 
tion ideas which they believed sampled the major 
dimensions across the four police functions. 

• These preliminary simulations were sent to nine 
leading police psychologists and: police officials 
who provided critical reviews and feedback con- 
cerning their appropriateness for use in assessing 
police job candidates. 

• Based on the above feedback, the most promising 
seven to ten simulations for each function were 
elaborated to give them realism. Instructions for 
administration were written and necessary physical 
props were provided to round out as fully as possi- 
ble each of the exercises. > 

• The above sets of police job simulation exercises 
were then critiqued in detail during an intensive 
one-day working conference of 1 1 police psychol- 
ogists and police officials. Attendees came from 
departments all over the country to attend the con- 
ference in Minneapolis. As a result, some exercises 
were eliminated, important modifications were 
made in all of them, and new simulations were 
designed for some of the functions. Output from 
this conference yielded a total of 30 fully elaborated 
job singulations: eight for patrol- officers, eight for 
detectives, five for sergeants, and nine for inter- 
mediate commanders. 

• The simulations were then pretested by actually 
administering them to police officers in the three 
cities of Minneapolis, Des Moines, and Cincinnati. 
A total of 77 officers agreed to participate in these 
pretests, including 16 patrol officers, 22 detectives, 
25 sergeants, and^ .14 iritermediate commanders. 
Each of the 30 simulations was pretested on an 
average of six police officers. Their comments and 
reactions during and afiter the pretests were rich in 
suggestions for final modifications to improve and 
''finalize" each of the simulations. At this stage, 
four more exercises were dropped leaving a total of 
26: 7 each for patrol officers, sergeants, and middle 
commanders,' and 5 for detectives. 

• • In order to provide a final full-scale evaluation of 
the assessment exercises, eight pilot assessment 
centers were held as shown below: 

xvl 



Pilot Assessment Centers 

City Type 

Patrol Detective Sergeant Command 

Chattanooga X X 

Minneapolis X X 

Portland, Oregon ■ X X 

Washington, D. C. X X 

These final pretests were highly, successful. Even with 
minimal training, assessor staff members were able to 
make sound behavioral observations, perform accurate 
ratings of candidates, and come to good agreement about 
the relative overall effectiveness of the candidates whom 
they observed. 

C. Project Findings and Project Products 

1. Scoring keys. Our analyses of the statistical rela- 
tionship between job performance ratings and responses 
\: items in the experimental test battery yielded several 
scoring keys for each of the four police functions. These 
keys arc listed below for each of the four functions: 

Patrol officei keys 

• Key PI, called Public Contact, is most closely re- 
lated to those aspects of the officer's job involving 
dealing constructively and effectively with the pub- 
lic on a one-to-one basis. 

• Key PII, called Overall Performance, is most 
closely related to ratings of overall job effectiveness 
as a patrol officer. 

• Key Fill, called Crime Prevention, is most closely 
related to those aspects of the officer's job involving 
alertness to suspicious situations, detecting and in- 
vestigating crimes, and maintenance of public 
safety. 

o Key PIV, called Cooperation, is most closely re- 
lated to those aspects of the officer's job involving 
effective cooperation with other officers and other 
law enforcement units. 
Our analyses suggest that the minimum estimated me- 
dian valicfity for these patrol officer keys is .24. When 
scores from them are combined to form a composite 
TOTAL POTENTIAL score, the validity may be in the 
range .30 to .35. 

Detective keys 

• Key DI, called Overall Performance, is most 
closely related to ratings of overall job effectiveness 
as a detective. 

• Key on, called Personal Integrity, is related to 
those aspects of a detective's job involving fairness 
and intejgrity in dealing with all cases equally and 
resisting opportunities to use one's badge for per- 
sonal gain. 
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Our analyses suggest that the miniinuni estimated me- 
dian validity for these detective keys is .25. When scores 
from them are combined to form a composite TOTAL 
POTENTIAL score, the validity may be in the range of 
.35. 

Sergeant keys 

• Key SI, calltd Supervisory Coordination, is related 
to those aspects of a sergeant's job involving in- 
spection of personnel and equipment, scheduling 
duty time, and deploying officers and equipment 
with wisdom and initiative. 

• Key SII, called, SMp^rvi^ory Consideration, is re- 
lated to those aspects of a sergeant's job involving 
avyareness of sub'Ordi nates' needs, recognizing and 
praising good perfomnnce, and training oi* orient- 
ing subordinates toward good performance. 

Our analyses suggest that the minimum e^stimated me- 
dian validity for these sergeant keys is .20. When scores 
from them are combined to form a composite TOTAL 
POTENTIAL score, the validity may be in the range of 
.25. 

Middle level command keys 

• Key CI, called Administration, is related to those 
aspects of a middle commander's job involving 
administrative and scheduling duties, such as 
paperwork, assigning manpower, and organizing 
office procedures. 

• Keys CII and CIII both are called Overall Perform- 
ance, and both are related most closely to ratings of 
overall job effectiveness in middle level command 
positions (lieutenants and captains). 

• Key CIV, called Dedication, is related to those 
aspects of a middle commander's job involving 
dedication, setting a good example, and resisting 
opportunities to use one's position for personal 
gain. 

• Key CV, called Personnel, is related to those as- 
pects of a middle commander's job involving work- 
ing with subordinates in areas related to their evalu- 
ation, motivation, discipline, and development. 

Our analyses suggest that the minimum estimated me- 
dian validity for these middle level command keys is .30. 
When scores from them are combined to form a compos- 
ite T01.\L POTENTIAL score, the validity may be in 
the range of .35 to .40. 

2. Validities by city, by race, and by sex. City-by-city 
comparison of the validities of the above scoring keys 
shows that they axe impressively consistent and that they 
are very similar to those obtained for the overall samples. 
Not only are the actual magnitudes of validity coeffi- 
cients similar from city to city, but the pattems of higher 



and lower values are similar over all cities. These results 
suggest that the scoring keys may be used as they stand 
to help make personnel decisions about applicants for 
police work and candidates for promotion. However, 
such use should, of course, be accompanied by studies to 
establish local norms and local validity information 
specific to each department. 

A sufficient number of female officers was available 
for separate validity analysis only in detective jobs. Va- 
lidities for the small group of female detectives (number- 
ing only 15 to 25) were lower for the DI key but about 
the same for the DII scale as for all detectives combined. 

Sufficient numbers of minority officers were available 
for separate validity analysis for patrol officer, detective, 
and sergeant jobs. Validities are essentially the same for 
whites and for non-whites for the patrol officer and 
&?rgeant scoring keys. In contrast, validities for the de- 
tective scoring keys are uniformly lower for minority 
officers than for officers in the total sample of detectives. 
Studies of mean differences in performance ratings and 
in scoring key scores between white and non-white offi- 
cers showed that adjustments needed to be made for 
minority candidates in order to assure tha\ persons, re- 
gardless of race, with equal probabilities of showing 
particular levels of job performance effectiveness will 
obtain approximately the same scores on the TOTAL 
POTENTIAL composites of the POLICE CAREER 
INDEX scoring systems. 

At present, we can recommend use of these scoring 
systems for both minority and non-minority candidates 
for patrol officer and sergeant police functions. Use of 
the scoring systems for women and for minority persons 
for the detective function is not currently recommended. 
Evidence concerning possible sex differences is not 
available from our research for police functions of patrol 
officer, sergeant, and middle command. Evidence about 
possible race differences is not available from our re- 
search for middle command police functions. 

J. Operational use ofPOUCE CAREER INDEX, The 
POLICE CAREER INDEX consists of three inventories. 
The first inventory contains 393 items made up of back- 
ground information, personality-type items, and items 
involving preferences for various activities. It contains 
all material necessary for scoring the patrol officer and 
detective keys and most of the sergeant and middle 
command keys. The second inventory contains 82 job- 
situation items relevant specmcally to the sergeant func- 
tion, and the third inventory contains 75 job situation 
items relevant specifically to the middle command func- 
tion. The inventories can be administered quickly and 
easily by a competent clerical person to groups of candi- 
dates numbering as large as 75 to 100. The time required 
for administration is no more than 2.1iours (the average 
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time for a candidate is about 75 minutes) for the Bio- 
graphical and Persona! Information Inventory and about 
45 minutes for either one of the Situational Judgment 
Inventories. When fully operational, candidates' com- 
pleted inventory booklets may be mailed to a central 
scoring location where responses ai keypunched, au- 
tomatically scored, and interpretive profiles printed by 
computer and returned to the site of testing. Turnaround 
time between date of testing and date of receiving com- 
pleted results typically should be about 3 to 4 days at 
most. 

4. Regional assessment center materials. Assessor's 
manuals have been prepared for each of the four police 
functions. The manuals contain complete definitions for 
the assessment dimensions taped by the simulations; de- 
tailed instructions for assessors on how to conduct exer- 
cises, observe candidates, and evaluate their perform- 
ance; sample copies of all written instructions and mate- 
rials for candidates; and sample copies of all report ^Snd 
rating forms to be completed by assessors after each 
exercise. The manuals were designed to be used by 
persons serving as assessors when police assessment 
centers become operational. For convenience, pages are 
color-coded according to whether they are explanations 
and instructions for assessors, instructions and other 
written materials to be used by candidates, or rating 
forms to be completed by assessors. 

5. Implementing regional assessment centers. Centers 
may now be established on a regional basis to offer 
ptilice assessment services periodically to local depart- 
ments in the area. At first, a cadre of persons should be 
trained, in each region who may be called upon periodi- 
cally to serve as staff members. Our experience with the 
pretesting suggests that an effective approach is to in- 
clude as staff members a mix of police officials, 
psychologists (who may be recruited from nearby 
schools, colleges, or universities), and local citizens ac- 
tive in some facet of social or community service work. 

Persons who arc to serve as assessors will require 
thorough training involving such things as: 

• Learning the definitions of assessment dimensions 
to be measured during the assessment center. 

• Reviewing the content and procedures of all exer- 
cises described in the Assessor's Manuals. 

• Practicing role-play exercises and becoming famil- 
iar with the standardized role sets to be assumed by 
assessors. 

• Practicing conducting background interviews. 

• Practicing recording behavioral observations of 
candidates' performance and making evaluative rat- 
ings of performance backed by behavioral observa- 
tions. 



• Observing experienced assessors as they conduct an 
actual assessment center, carry out role-play exer- 
^ cises and background interviews, make behavioral 
observations of candidates, and rate their effective- 
ness. 

Such training for assessors will probably require two 
or three days plus the time required to observe an actual 
assessment center being conducted by experienced asses- 
sors. 

After an assessment center, staff members will typ- 
ically pool their observations of candidates' performance 
and discuss candidates' overall effectiveness in the as- 
sessment dimensions. Assessors should discuss each 
other's observations and ratings for a candidate and reach 
consensus on how effective the candidate was on each 
dimension. The information may then be summarized in 
the form of a two- or three-page written report on each 
candidate's performance and his or her estimated poten- 
tial for success in the particular police'^fuhction being 
evaluated. The report will be sent directly to the candi- 
date's local department where it may be combined with 
all other personnel information to derive a final judgment 
about him or her. 

D. Combined Operational Use of Pbiice 
Career Index and Regional Assessment 
Centers for Personnel Decisions and 
Career Guidance of Police Personnel 

We have described the development and validation of 
POLICE CAREER INDEX inventories and the de- 
velopment and pilot testing of assessment center job 
simulations for each of four police functions. These 
materials are now ready and available for operational use 
by local departments to help them in making selection, 
training, promotion, job transfer, and cai^r counseling . 
decisions for police candidates and/or experienced police 
officers already working in their departments. 

Figure 1 shows how the POLICE CAREER INDEX 
inventories can be used in concert with Regional Police 
Officer Assessment Centers to provide information to 
local departments for use in carrying out the above per- 
sonnel decision practices. The various stages shown in 
Figure 1 arc described briefly below (The numbers on the 
boxes shown in Figure 1 refer to the stages discussed 
below.) 

1 . A local department seeking qualified candidates for 
vacancies would announce the availability of such 
positions and designate a date for administration of 
the POLICE CAREER INDEX (PCD Biographical 
and Personal Information Inventory. 

2. As candidates appear, the local department would 
carry out some form of preliminary scteening, such 
as brief interviews, reference checks, etc., to de- 
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velop a roster of candidates to be admitted to the 
PCI inventory administration session. Sufficient 
numbers of PCI booklets and answer sheets would 
be obtained; and, on the appointed day, all qual- 
ified candidates would complete the PCI inventory. 

3. Completed answer sheets would be forwarded to a 
centralized computer scoring service for scoring 
and automatic interpretation. At that time, the local 
department would also indicate the types of predic- 
tor scale scores desired for each candidate. Usually 
a department reviewing inexperienced candidates 
would probably request scoring for only the patrol 
officer predictor scales, although early guidance 
and training of a newly hired trainee could perhaps 
be enhanced by obtaining information relevant to 
the other police functions as well. 

Occasionally, a department might wish to evalu- 
ate an experienced police officer from some other 
department who might be under consideration for a 
supervisory or command job. At such times, the 
department would administer the appropriate PCI 
Situational Judgment Inventory (sergeant or middle 
command) in addition to the. PCI Biographical and 
Personal Information Inventory and request scoring 
on the appropriate keys. 

The scoririg service would carry out the scoring 
and return interpretative profiles (similar to those 
shown as^Figures 3, 4, 5, and 6 in Chapter 2) to the 
local department within 2 days. 

4. The PCI results would then be used in conjunction 
with additional departmental screening methods 
(such as physical examination, panel interview, 
etc.) to form an overall ranking of candidates. 

5. The overall ranking of candidates would, for most 
departments, probably lead directly to the accept- 
ance of the highest ranking persons to enter police 
training. 

Some departments might, however, seek further 
information on some of the candidates. These can- 
didates would be asked to attend a one-day Re- 
gional Patrol Officdir or Detective Assessment 
Center. This option would, of course, involve con- 
siderably greater cost to the department. But in 
• some instances, the richness of the behavioral in- 
formation might warrant obtaining siich informa- 
tion. ^ 

6. Each candidate finally accepted .*^hould then be 
interviewed in a * 'feedback'* session where the 
wealth of information obtained about her or him 
during the selection process would be discussed, 
with particular emphasis placed upon implications 
of the information for special training needs, areas 



of strength and weakness, possible career oppor- 
tunities, etc. 

7. Upon graduation from police academy training, 
officers would typically be assigned directly to 
police jobs either as patrol officers or as detectives. 
Again, some departments might seek further in- 
formation about an officer early in his or her career 
by asking him or her to attend a regional poli&'t 
assessment center. More typically, however, the 
job performance of young officers would be evalu- 
ated periodically according to the department's 
existing personnel practices. 

8. At some point in a young officer's developing 
career, the department might administer various 
inventories of the POLICE CAREER INDEX and 
request scoring on predictive scales bearing on 
detective, sergeant, and middle command jobs. 
Such information would then be used in conjunc- 
tion with the accumulating knowledge of the 
officer's job performance to build a preliminary 
roster of ''above average potential" officers for 
later promotional consideration when advancement 
opportunities develop. 

9. At some stage (or, perhaps on several occasions) in 
an officer's career, the department would ask that 
he or she attend a regional police assessment 
center. There, the officer's potential would be 

' evaluated according to the simulations and be- 
havioral observation methods described in Chapter 
3. If PCI information were not available on a can- 
didate at the time of attending the regional center, 
the information would be obtained at that time as 
part of the total assessment center procedure. 
10. Information about the officer's performance at the 
regional center would then be transmitted to ap- 
propriate persons in the department. It is desirable 
that » the same information be given, with de- 
partmental approval, to the officer so that optirnal 
use would be made of itl in developing jointly 
agreed upon career recommendations, guidelines 
for further personal development, and basic be- 
havioral information to be combined with all other 
information in developing a firm evaluation of his 
or her potential for serving effectively in the whole 
range of police positions available in the depart- 
ment. 

The two "instruments" developed in this research 
program provide a total personnel evaluation sys^f t^i for 
decision making at all levels of police work, ringing 
from entry to the force to career guidance for individual 
officers and the development of increiisingly accurate 
estimates of poten|ial as those officers gain maturity and 
experience in their jobs. The central and most important 
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feature of these two coordinated assessment methods (the 
POLICE CAREER INDEX and the job-focused police 
officer assessment simulation exercises) is their ground- 
ing, at every stage of development, in behaviorally 
explicit patterns defined by the most critical features of 
police officer job performance. Thus, the POLICE 
CAREER INDEX scales are directly interpretable ac- 
cording to expected patterns of police job performance 
instead of being in the form of the usual traits measured 



by psychological tests. And, the assessment simulations 
have been shown to elicit successfully exactly those 
behavior patterns discovered to be critical to successful 
performance in different police jobs. The total evaluation 
system shown in Figure 1 provides a base, therefore, for 
gathering and accumulating information over time that is 
increasingly relevant and accurate for making personnel 
decisions about persons and jobs in police departments. 
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CHAPTER I. BACKGROUND, RESEARCH NEEDS, AND 

RESEARCH APPROACH 



A. Background 

Turbulent evenrs over the last 15 years have forced 
upon the American public a profound awareness of the 
effectiveness or lack of effectivenes;s of its law enforce- 
ment agencies. In their recent book titled Po/zc^ Person- 
nel Administration. Stahl and Staufenberger (1974) 
comment that of all issues facing contemporary law en- 
forcement, the one that is most central and of absolutely 
critical, importance involves the quality, motivation, and 
utilization of the men and women who comprise local 
police, agencies. 

The principal objective of the extensive research pro- 
gram reported here has been the development and valida- 
tion of a series of personnel assessment procedures to aid 
in evaluating applicants for pdlice work and for develop- 
ing programs of career guidance and upgrading for per- 
sons already in police work. 

A first step in our research program was to learn as 
much as possible about the state of the art in police 
selection and promotion practices. A comprehensive re- 
view of the research literature (Groner, Johnson, & Dun- 
nette, 1972, Heckman, Groner, Dunnette, & Johnson, 
1972) yielded the following conclusions: 

• First, much of the research has been rather spotty 
and piecemeal; no single **best" procedure for 
selecting police officers was identified. Some re- 
search studies (notably, Baehr et al., 1968; and, 
Furcon et al., 1971) have yielded potentially useful 
test validities, but the relative utilities of total selec- 
tion, systems have not been evaluated. 

• Second, the focus of criterion research about the 
parameters of police effectiveness has been only 
weakly oriented toward ac^;]al dimensions of job 
performance. Most studies have relied upon criteria 
such as existing departmental ratings or global 
measures (such as rankings) of overall effective- 
ness. In many studies, therefore, raters have been 
left free to use their own potentially biased defini- 
tions of what constitutes police officer effective- 
ness, with the result that the usual sources of rating 
error (leniency, halo, etc.) probably have been quite 
prevalent. 

• Finally, directions for next steps in police selection 



research were clearly evident. They included 
thorough job analyses and the use of critical inci- 
dents methodology to formulate behaviorally an- 
chored rating scales (Landy & Goodin, 1974) for 
use in evaluating officers' levels of job effective- 
ness. } 
A more recent overview of current practices, 
strategies, and research needs in police officer selection 
(Eisenberg & Murray, 1974) also points up the critical" 
importance of careful job analyses and better criterion 
development as a necessary basis for assessing future 
success in developing improved evaluation and person- 
nel decision procedures for police applicants and police 
officers. 

B, Research Needs, Early Results, and Re- 
search Approach 

Though our literature review was helpful, it needed to 
be supplemented with knowk dge of how police person- 
nel selection practices and fioblems may be viewed by 
practitioners. To this end, we interviewed top officials In 
32 police departments in small, medium, and large cities 
throughout the country. (See Heckman, Groner, Dun- 
nette, & Johnson, 1972, for a summary of interview 
findings.) Literature review and interview results formed 
the basis for a series of planning sessions directed toward 
formulating a broad research design for developing new 
police personnel evaluation and selection procedures. A 
central feature of the research plan came to be an em- 
phasis on studying the critical features of four different 
police jobs: General Patrol Officers, Patrol Sergeants, 
Investigators or Detectives, and Intermediate Command 
Personnel (Lieutenants and Captains). Defining the criti- 
cal dimensions of job performance for each job area 
would yield information that could be used in two dis- 
tinct but importantly interrelated ways: 

• First, critical incidents of actual police performance 
could form the basis for designing police job simu- 
lations or situational exercises which could be used 
to design assessment centers for evaluating the job 
potential of candidates. 

• Second, such critical incidents of actual police per- 
formance could be used to define dimension? of job 



performance effectivenccs and to design behavior- 
ally anchored rating scales for use in evaluating 
current job performance effectiveness of police 
officers. These rating scales could be used in a 
concurrent validation study to discover test and in- 
ventory item responses related to different levels of 
effectiveness for various performance dimensions. 
In essence, then, our research plan was directed to- 
ward developing tAvo types of ^^instruments" or proce- 
dures for use in evaluating candidates for each of four 
police jobs. One would be a brief (about two hours), 
easily administered and objectively scored inventory (the 
POLICE CAREER INDEX) to be used in the prelimi- 
nary screening of applicants for police jobs. Our research 
plan was to examine inventory responses according to 
different patterns of rated performance on the behavior- 
ally anchored scales and to combine valid items into 
behaviorally relevant scoring keys. Thus, scores on the 
POLICE CAREER INDEX would be intcrpretable di- 
rectly according to expected patterns of job performance 
instead of being in the form of the usual traits measured 
by psychological tests and inventories. The second type 
of evaluation procedure would be in the form of a series 
of police job simulations to be used in police assessment 
centerL. The police assessment centers would be avail- 
able on a regional basis for use in evaluating the relative 
career potential, strengths and weaknesses, and training 
or developmental needs for police job candidates and/or 
currently employed police officers. 

Figure 1 shows how the POLICE CAREER INDEX 
might be used in concert with regional police assessment 
centers to aid local departments in making selection, 
training, promotion, job transfer, and career counseling 
decisions for police candidates and/or experienced police 
officers. 



The following steps were identified as being necessary 
for developing the two types of evaluation procedures 
shown in Figure 1: 

1. Leam critical behaviors associated with effective 
and ineffective job performance in each of four 
police department jobs (Patrol Officer, Detective, 
Sergeant, Middle Command). 

2. Develop behaviorally anchored job performance 
rating scales for each of four police department 
jobfi. 

3. Design and pretest performance samples (job simu- 
lations) to tap aspects of critical job performance 
dimensions for each of four police department 
jobs. 

4. Validate and standardize inventories, tests, ques- 
tionnaires, and personal history information for use 
in estimating likely patterns of job performance in 
each of four police department jobs (PCI). 

5. Design and pilot test for operational readiness the 
specific procedures for conducting regional police 
assessment centers for each of four police depart- 
ment jobs. 

The fii'st two research steps were accomplished during 
the first year's research under Grant Awaid No. NI71- 
085-G. These activities and results are described in de- 
tail in the technical report by Heckman, Groner, Dun- 
nette, and Johnson (1972). Step 4, the development of 
the PCI inventories, is described in Chapter 2 of the 
present report. Steps 3 and 5, the design and pretesting of 
simulations and the design and pilot testing of the as- 
sessment centers, are described in detail in Chapter 3 of 
the present report. Recommendations for operational use 
of the PCI and for implementing regional police assess- 
ment centers are given in Chapter 4 of the present report. 
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CHAPTER II. DEVELOPMENT OF THE POLICE CAREER 

INDEX (PCI) 



A. Sequence of Development 

. As mentioned in Chapter 1 , Step 4 v'^f our research plan 
called for validating inventories, questionnaires, tests, 
and personal history information to develop four, stand- 
ardized, relatively brief, and easily administered inven- 
tories for use in the preliminary screening of candidates 
for each of four police jobs: Patrol Officer, Detective/ 
Investigator, Sergeant, and Middle Level Command Per- 
sonnel. We. decided that the basic design of these four 
validation studies would be concurrent validation instead 
of predictive validation. (See Dunnette (1966) for a dis- 
cussion of concurrent and predictive validation designs.) 

The latter design would have required that applicants 
for each of the four police jobs be administered an 
experimental battery of tests and inventories, that some 
of the applicants be selected without regard to results on 
the tests, and that their actual Job performance be evalu- 
ated after they had been on the job for some period of 
time. (Probably a year or more would be required before 
much confidence could be placed in job performance 
evaluations of these newly placed officers.) Only at the 

»4ater time, after performance had been evaluated, could 
analytic procedures be undertaken to select the most 
valid items to comprise the final forms of the four PCIs. 
We did not want to suffer such a delay in our research 
program. Therefore, we determined to work with experi- 
enced officers. * 'Experienced'' was defined to include 
officers who had been in a particular police job for over 

. one year but less than five. By setting an upper limit of 
five years ifor each job area, we hoped to avoid drawing 
into cur samples those officers who were much older 
than typical candidates for each of the four police jobs. 
We believed that inclusion of long-term officers or 
**old-timers" in our sample groups would introduce un- 
desirable, age-related variance into both the job perform- 
ance evaluations and the responses to items of the ex- 
perimental tests and" inventories. Unfortunately, we were 
not able in all instances to satisfy the intended constraints 
on length of service* Thus, officers with more than five 
years of experience did participate in our research in 
certain of the cooperating departments. 

Having decided to use^he basic design of concurrent . 



validation, the sequence of steps necessary for develop- 
ing the four PCIs became clearcut. These steps are listed 
below: 

• iSelect or develop experimental tests and inventories 
to be administered to police officers. 

• Secure cooperation from police departments so that 
broad geographical representation is assured. (Our 
initial goal was to obtain completed test and job 
performance information from 75 patrol officers, 
750 detectives, 400 sergeants, and 400 middle 
command officers.) 

• Administer experimental tests and inventories to 
police officers in the various cooperating police 
departments. Gather job performance descriptions 
(ratings) on behaviorally anchored scales from one - 
or more senior officers for each of the officers tested 
with the experimental batteries. 

• Analyze criteilon (job performaiice ratings) infor* 
mation for officers in each job area 'according to 
interrater agreement and dimensionality of behavior 
descriptions. Choose the best criterion ratings to be 
used for analyzing test and inventory responses for 
each job area. 

• Conduct item analyses separately for each inventory 
against each criterion dimension within each job 
area. Select most valid items and combine them to 
form '^predictor'* scales. Estimate cross-validities 
for each of the predictor scales. 

• Examine predictor scale validities separately by 
police department and for persons subgrouped ac- 
cording to variables such as race, sex, age, etc. 

• Develop standardized scoring and interpretive sys- 
tems for reporting results for each of the four PCI 
invehtO|ies. 

These seven steps are described in the following 
pages. 

B. Selection and Development of Experi- 
mental Tests and Inventories 

I. Critical performance dimensions. The comprehen- 
sive study of critical performance dimensions for the four 
police jobs during our first year's research provided the 



basic knowledge necessary for inferring the kinds of tests 
and inventories likely to be most predictive of police 
performance. Since each performance dimension was 
defined according to. actual critical behaviors or inci- 
dents, our research staff could actually select and/or 
write items hypothesized to be related to specific be- 
havioral incidents/dimensions/areas. The dimensions for 
each of the four jobs are listed below. Dimension titles, 
thdr general definitions, and the scales defining them are 
given in Appendix A of this report. The reader who 
wishes to review the hundreds of incidents that were 
actually gathered should refer to Heckman, Groner, 
Dunnette, and Johnson (1972). 

Patrol Officer dimensions. The 1 1 dimensions used to 
describe the patrol officer's job included the following: 

a. Crime Prevention 

b. Using Force Appropriately 

c. Traffic Maintenance and Control 

d. Maintaining sPliblic Safety 

e. Investigating, Detecting, and Following Up on 
Criminal Activity 

f. Report Writing 

g. Integrity and Professional Ethics 

h. Dealing Constructively with the Public 

i. Handling Domestic Disputes 

J. Commitment, Dedication, Conscientiousness 
k. Team Work 

Detective/Investigator dimensioyy\. The 12 dimensions 
used to describe the detective/investigator job included 
the following: 

a. Investigating the Scene of a Crime 

b. Arrest, Search, and Seizure. 

c. Interrogating Suspects 

d. Investigating a Case 

e. Developing and Utilizing Informants 

f. Report Writing and Paperwork 

g. Appearing in Court 

h. Public Relations 

i. Dealing with Juveniles 

j. Cooperating with Other Officers and Divisions 
k. Conscientiousness and Dedication 
1. Integrity and Honesty 

Sergeant dimensions. The eight dimensions used to 
describe the sergeant's job included the following: 

a. Concern for Subordinates 

b. Scheduling, Coordination, Deployment, and Man- 
power Allocation 

. c. Supervision 

d. Performing Administrative and Inspection Func- 
tions 



e. Decision Making and Initiative Where No Firm 
Guidelines Exist 

f. Training and Planning 

g. Integrity, Dedication, and Conscientiousness 

h. Dealing Effectively with the Public and Superiors 

Middle Command dimensions. The nine dimensions 
used to describe the middle command job included die 
following: 

a. Administrative Duties 

b. Communications 

c. Scheduling 

d. Training 

e. Supervision 

f. Commending, Disciplining, and Assigning Effi- 
ciency Ratings 

g. Field Command Situations 

h. Public and Community Relations 

i. Dedication, Integrity, Setting an Example 

C. Assignments for Test Item Selection and 
Writing 

Seven research staff members were assigned the task 
of systematically examining the performance dimensions 
and writing items or selecting items from existing tests 
and inventories to tap those dimensions. Various types of 
tests or items also were specified as follows: 

• Personal history or biographical items 

• Personality items drawn from widely used inven- 
tories, such as tht Minnesota Multiphasic Personal- 
ity Inventory, California Psychological Inventory, 
etc. 

• Likes and Dislikes or preference type items such as 
are contained in widely used vocational interest 
inventories. In addition to choosing items from 
existing inventories, special items were written that 
seemed to be particularly focused on preference 
areas inferred from the .^^tudy of specific perfor* 
mance dimensions. An example of a series of ten 
preference items written to t^ different aspects of a 
patrol officer's job is shown in the following: 

• "Mark (X) which three of the following you LIKE 
BEST and which three you LIKE LEAST. 
UKE UKE 

BEST LEAST 

— : giving orders and getting 

things moving 
analyzing your own motives 

and feelings 

working on a job that makes 

you feel that others depend on 
you whether or not you 
are on duty 
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not having to work evenings 

and weekends 

having a job where you don't 

have to get all fired up about it 

having general directions on 

how to do a job but being able 
to work out the details your- 
self 

thinking about how it would 

feel to be held at the point of a 
gun 

reading detective siories 

working with one other per- 
son 

putting yourself in someone 

else's place and imagining 
how you would feel in the 
same situation.*' 

• Cognitive tests that had been shown lo be useful in 
other studies such as Baehr et al. (1968), Furcon et 
al. (1971), or which might be inferred to be useful 
from a study of specific performance dimensions. 

• Situational judgment items. The hundreds of actual 
critical incidents gathered as part of the develop- 
ment of performance dimensions were used to write 
items descriptive of situations an officer might en- 
counter in carrying out his/her job. Alternative ac- 
tions were developed, and the response format 
asked the respondent to choose the BEST and the 
WORST actions from the alternatives listed. An 
example of such a situational type item for a patrol 
officer's job is shown in the following: 

• "While off duty, you observe a uniformed officer 
drinking in a bar. You would . . . 

R PST 1. ignore the incident complerely. 

WORST 2. find out who the officer is, 

whether or not he was on duty, 
and then call him aiid tell him 
to be more careful in the intmxi 
about drinking while in uni- 
. form. 

3. mention the incident to your 
shift supervisor and give him 
the man's badge number. 

4. write down his badge number 
and report him to the chiefs 
office." 

In developing these situational items, meetings were 
held with senior police officers and members of the 
Training Division of the Minneapolis Department to 
solicit their advice about the degree of realism 
shown by the items and the types of alternative 



actions that were neither obviously correct nor ob- 
viously wrong. 
• Miscellaneous items. Various scales and inven- 
tories purporting to measure such areas as 
Internal-External Control, Dogmatism, Repressor- 
Sensitizor, Values, Self-Esteem, Needs, etc. were 
examined. 

Staff members were assigned joint responsibilities for 
compiling various item types and for focusing on specific 
performance dimensions. Specific guidelines for the 
selection and writing of items weiv spelled out in a 
memo from Dunnette to sta^ members dated 25 Sep- 
tember 1973. The memo read in part as follows: 

"What constitutes 'good' items? They should be clear 
and easily understood — no big or unusual words, no 
double or triple negatives, no wordings that trap the 
respondent (such as, 'Have you stopped beating your 
wife?' or *I wish I didn't worry so much ^bout sexual 
matters.'). They should not tap identical inform ition; 
that is, screen your items for overlap and redundancy. 
They should seem to be relevant to the beS7avior di- 
mensions; or, if not, they should have proved useful in 
previous studies or be judged as potentially usefiil by 
some expert or be part of a scale that seems important. 
They should not be obviously related to race or sex, 
though this will, of course, be difficult to accomplish 
in many instances. 

"Guidelines about numbers of items to be included are 
obviously difficult to give. But here's roughly what we 
might hope to have available for examination: 

Personal history — 

biographical 200-250 

Personality 400-500 

Likes and Dislikes 75-100 

Cognitive indeterminate 

Situational Judgment 100-125 

[for each police job] 

Miscellaneous 125-150" 

As soon as a preliminary battery of tests and inven- 
tories had been compiled for patrol officers, it was pre- 
tested with the help of 30 Minneapolis officers. Results 
of the pretest were as follows: 

• Administration time was far too long. Nearly 6 
hours were required instead of the intended 4 
hours. This required dropping a number of the more 
esoteric scales from the inventories and the drop- 
ping of certain clerical type tests wiiich had been 
initially introduced as a me^ms of tapping spelling 
and granuTiU^ical kiiov/ledge. 

• The initial situational judgment inventory was mod- 
ified in accordance with conmients made by the 
responding officers. The response format, which 
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had initially asked for a ranking of alternative ac* 
tions, was also changed to the far siinpier BEST- 
WORST format mentioned earlier. (This pretest 
experience, during which many of the officers com- 
plained about the items in the situational judgment 
inventory, was instrumental in causing us to solicit 
help from senior officers in the development of all 
other situational inventories.) 

• Response distributions were examined for items of 
the Likes-and-DisIikes Inventor}', the Biographical 
Inventory, and the Personality-type items. Items 
showing extreme resf>onse distributions (over 90 
percent of respondents answering in the same way) 
were deleted from the inventories. 

D. Contents of Experimental Batteries 

The above procedures yielded experimental batteries 
for administration to police officers. The tests and inven- 
tories comprising the batteries are described briefly as 
follows: 

1. Personal history/biographical inventory. This in- 
ventory contained 149 items covering all aspects of 
background information. A sampling o£ areas covered 
and types of items includes: 

• Personal characteristics, such as age, sex, race, 
height, weight, etc. 

• Family background information, such as family 
size, relationships with siblings and parents, etc. 

• High school accomplishments, experiences, and in- 
terests, such as scholastic achievement, courses 
liked or disliked, extracurricular activities, jobs 
held in high school, size of high school, etc. 

• Descriptions of personal style, such as degree of 
aggressiveness, approach to solving problems, 
supervisory or leadership approach, degree of 
sociability, etc. 

• Self-descriptive items, such as attitudes or opinions 
about hard work, risk taking, other persons' traits, 
desired goals, relative importance of various things 
to work and life satisfaction, etc. 

o Several rather lengthy check lists of things that may 
or may not have happened to the respondent.* 



*An 'example of one such check list is item 136, 
shown below: 

136. Which of the following have you done? (Circle 
all that apply) 

1. sold door to door (e.g.. Fuller Brush (nsui) 

2. contract selling (encyclopedias, insurance) 

3. worked in a gasoline station 

4. clerked in a service establishment (such as a dry 
cleaner or shoe repair shop) 



An important feature of this biographical inventory 
was that we asked respondents to answer the questions 
according to their particular siuiations at the time they 
were being considered for their present positions. The 
directions read as follows: 

'*As you read each question, think back to the time 
when you first applied for your present position. An- 
swer each question according to the way circu:nstances 
were then and not as they are now. In other words, 
assume that you are back to the time when you first 
applied for a position similar to the one you now 
have." 

We hoped, of course, that this tactic would take us a 
step closer to discovering truly predictive relationships 
between personal history information and rated effec- 
tiveness in various police functions. Many aspects of 
biographical information change over the early years of a 
person's career (such as marital status, personal styles, 
attitudes, and opinions, etc.) Since the intended use of 
the pa is for persons being considered for police jobs, it 
was important to obtain reports of biographical status 
prior to the effects of such career or time determined 
changes. 

2. Opinion and self-description inventories. Personal- 
ity type items were gathered from many existing person- 
ality inventories, such as thQ Minnesota Multiphasic Per- 
sonaliiy Inventory *thQ California Psychological Inven- 
tory, th^ Guilford'Zimmerman inventories, tht Jackson 
Personality Research Form, etc. An initial selection 
of items was done by choosing those contained in scales 
shown in other studies to be correlated with police effec- 
tiveness. A secondary selection of items was ac- 
complished by using our own clinical intuition to decide 
whether or not an item's content might be related to the 
various behavioral dimensions shown to be , impor- 
tant in police jobs. As already mentioned, a small pretest 
among 30 Minneapolis police officers was used to delete 
items with extreme (90%-10%) response distribution 
splits. A total of 473 items was finally selected. Of these, 
418 were in the form of a simple True ov False i^sponse 
format. The remaining 55 requecisd a True, Can't Say, 
oxFalse response. Two inventories were, therefore, pre- 



5. worked in a restaurant 

6. sold in a retail store (such as a department store) 

7. worked in a business office 

8. conducted an interview 

9. worked as a reporter 

10. made a speech before a large group 

11. none of the above 
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pared for the opinion and self-description items: Part I, a 
kind of warmup inventory containing the 55 three- 
response option items and Part II containing the remain- 
ing 418 items. 

3. Cognitive tests. Only four cognitive tests were fin- 
ally chosen for use in the experimental batteries. All are 
extremely short and brief (5 minutes) factor analyti- 
cally derived measures of specific aptitudes. They are 
tests 1, 4, 7, and 10 of the Employee Aptitude Survey 
(Ruch & Ruch, 1963): 

Test 1: Verbal Comprehension, a test of vocabulary 

knowledge; ability to use words in oral and written 

communication. 

Test 4: Visual Speed and Accuracy, a test of speed and 
accuracy in perceiving details; requires the examinee 
to examine pairs of numbers and symbols and indicate 
which pairs are the same and which are di^erent. 
Test 7: Verbal Reasoning, a test of the ability to utilize 
facts in a logical way to derive a correct conclusion or 
to determine that no firm conclusion is possible from 
thr facts pres:nted. 

Test 10: Symbolic Reasoning, a test involving cogni- 
tive processes similar to the verbal reasoning measure 
but utilizing symbols instead. Three sample items 
from Test 10 and their correct answers are shown 
below: 

TRUE FALSE ? 

1. X = Y = Z; 

therefore, X = Z J 

2. X > Y > Z; 

therefore, X = Z J 

therefore, X Z / 

In addition to the above tests and inventories, different 
situational inventories (titled Situational Judgment In- 
ventory) were developed for each of the four police jobs, 
and three different Likes and Dislikes inventories for 
patrol officers, detectives, and supervisory/management 
jobs (sergeants and middle command personnel). The 
situational judgment inventories contained 86 items for 
patrol officers, 90 for detectives, 97 for sergeants, and 88 
for middle command personnel. The Inventories of Likes 
and Dislikes contained 205 items for patrol officers, 213 
for detectives, and 195 for supervisory/management 
jobs. 

E. Administration of Tests and Collection of 
Performance Ratings 

Police departments in nine cities located throughout 
the country agreed to cooperate with us in our collection 
of test and job performance information. A supplemen- 
tary grant from the Law Enforcement Assistance Ad- 



ministration allowed us to compensate officers for time 
required for the test administration and for the time 
involved in completing performance ratings for subordi- 
nate officers. Most of the data collection was, therefore, 
carried out during off-duty hours for the participating 
officers. The data collection occurred over almost 
exactly a year's time extending from mid-October 1973 
through mid-October 1974. During that time, some form 
of information (test and/or rated performance) was col- 
lected from or about over 2,000 police officers from 
departments in the cities of Albuquerque, Cincinnati, 
Des Moines, Miami (Dade County), Minneapolis, Pon- 
land (Oregon), San Diego, Tucson, and Washington, 
D.C. 

Table 1 shows types of data collected, kinds of 
police officers represented, and dates for each of the nine 
cities. Table 2 shows the total numbers of police officers 
for whom information was finally obtained in each of the 
cities. Note that performance ratings were obtained for 
larger numbers of patrol officers than were tested in the 
two cities of Minneapolis and Portland. Our intention 
was to compare mean job performance ratings of the 
officers who took tests with the mean job performance 
ratings of all officers in the department.. However, logis- 
tic difficulties prevented us from obtaining ratings for the 
entire population of patrol officers in either Portland or 
Minneapolis. Nonetheless, comparison of performance 
rating means for all tested and all rated officers provides 
a crude estimate of the degree of representativeness of 
the officers who were tested in these two cities. Com- 
parisons are shown later in the section devoted to our 
discussion of criterion analyses. [Note that the numbers 
rated and the numbers actually tested differ slightly in 
several other cities as well. These discrepancies occurred 
simply because testing session records were not always 
entirely complete at the time the rating sessions were 
held. Therefore, the rosters for the rating sessions con- 
tained some names of persons who were not tested and, 
unfortunately, failed to contain a few who actually were 
tested.] Information in Table 2 shows that we reached 
our sample size goal only for patrol officers. We came 
close to the goal of 400 for sergeants, but we severely 
undershot the goals of 750 for detectives and 400 for 
middle command officers. 
1. Test administration. 

a. General approach. Before administering any 
tests, our test administrators (staff members from Per- 
sonnel Decisions, Inc.) explained the overalLpurpose of 
the research study as thoroughly as possible. Special 
emphasis was given to the confidentiality of all results, to 
the nationwide character of the study, and to the impor- 
tance of the part they were playing in helping to develop 
good guidelines for selecting future police officers. They 
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Table 1 

Data Collection Sequence According to Time, City, and Type of Police Jobs 



City 


Testing Dates 


Functions 
Tested 


Rating Dates 


Functions 
Rated 


Aibuquciquc 


July 31-Augusi 3, 1974 


D S M 


October 10, 1974 


D S M 


Cincinnati 


February 3-8, 1974 


t PD 


February 3-8. 1974 


P D 




March 25-29, 1974 


S M 


March 25-29, 1974 


S M 


Des Moinc<i 


February 17-22, 1974 


P D 


February 17-22, 1974 


P D 




March 10-15. 1974 


S M 


March 10-15, 1974 


' S M 


Miami (Dade County) 


March 2-6, 1974 


all 


March 23-26, 1974 


all 








April 29-May 4, 1974 


all 








October 13-15, 1974 


all 


Minneapolis 


October 15-19, 1973 


P 


October 73-24, 1973 


P 




February 12, 1974 


D 


October 29, 1973 


P 




March 20-21, 1974 


S 


April, 1974 


D 




April 9-10, 1974 


M 


April 25, 1974 


S 








May 1, 1974 


M 


Portland 


November 25-30, 1973 


P 


November 25-30, 1973 


P 




April 28-May 3. 1974 


DS M 


April 28-May 3, 1974 


all 


San Diego 


August 4, 1974 


DS M 


August 4, 1974 


D S M 


Tucson 


(Internal Testing) 


D S M 


October 9, 1974 


DS M 


Washington, D. C. 


April 7-11, 1974 


P D 


May 19-23, 1974 


PD 




May 19-23. 1974 


S M 


September 10-18, 1974 


all 








October 1-4, 1974 


all 



Kfy: P > Patmlmcn; D « Deieciivcs: S « Serj^eanis; M » Middle Level Commanders. 



Table 2 

Numbers of Police Officers Tested* and Rated According to City and Type of Police Job 



Patrol Officers Detectives Sergeants Middle Command TOTALS 





Tested 


Rated 


Tested 


Rated 


Tested Rated 


Tested 


Rated 


Tested 


Rated 


Albuquerque 






8 


8 


9 


9 


1 


1 


18 


18 


Cincinnati 


135 


146 


63 


67 


68 


74 


28 


28 


294 


315 


Des Moines 


109 


116 


29 


33 


43 


46 


20 


23 


201 


218 


Miami (Dade County) 


82 


98 


71 


94 


55 


54 


31 


31 


239 


277 


Minneapolis 


190 


238 


48 


54 


40 


40 


31 


28 


309 


360 


Portland 


-81 


141 


52 


62 


16 


18 


20 


23 


169 


244 


San Diego 






56 


56 


53 


53 


31 


31 


140 


140 


Tucson 






22 


22 


3 


3 


3 


3 


28 


28 


Washington, D. C. 


171 


173 


103 


89 


♦)5 


93 


50 


49 


419 


404 


TOTALS 


768 


912 


452 


485 


382 


390 


215 


. 217 


1817 


2004 



•Note: In no ciiy did e*Klly Ibe -amc number of officer* complete all lests of the battery. Because of time limitations, from five to ten fewer officers in some cities completed the Likes and 
Dislikes Invemoiy and/or the Opi.iion and Self •Description Inventory. The numbers above refer to the numbers of individuals tested, regarxtiess of whether or not they completed a// tests. 



were told that no one in their department would ever 
have access to any results and that their test performance 
could in no way affect their current or future job status. 
Nonetheless, they were urged to do their best and to take 
the tests seriously in order to give an accurate portrayal 
of how an applicant might approach such a testing ses- 
sion. Finally, they were informed that they should not 
place their names anywhere on the tests. We explained 
that leaving their names off the tests would be a 
safeguard against the remote possibility of any tests 
being lost or misplaced. The tests and inventories of each 



battery were, however, numbered and each police officer 
wrote his name and test battery number on a roster. We 
explained that the numbers were necessary for thice 
reasons: (1) to keep each person's tests and inventories 
together as a package; 2) to develop a roster of names for 
use in writing the checks to reimburse them for their 
time; and, (3) to allow us to develop further information 
about their job performance so that their testings results 
could be correlated with factors such as their amount of 
experience and overall **style" in their jobs. We did not 
explicitly mention the necessity of obtaining job perfor- 
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mance ratings for each participant. If anyone asked 
whether or not such ratings would be obtained, the ad- 
ministrator said that they would be and took the opportu- 
nity to reemphasize the fact of tight security and com- 
plete confidentiality of all such research information. 

. b. Actual administration, A specified order was 
used for administering the tests and inventories. The 
cognitive tests were administered first because they are 
the only ones with specific lime limits. The tests of 
Visual Speed (EAS Test 4) and Verbal Comprehension 
(EAS Test 1) were administered first, because their for- 
mats and content are rather common and probably quite 
familiar to most persons. Be ginning with relatively 
familiar tests seemed to be a good way of gaining early 
report with the examinees. The test of Verbal Reason- 
ing (EAS Test 7) was administered next, followed by the 
test of Symbolic Reasoning (EAS Test 10). 

The remaining inventories, stacked in a particular or- 
der, were then distributed to the poDce officers. The test 
administrators went over the directions for each of the 
inventories. After allowing time for questions and further 
clarification, the examinees were instructed to work at 
their own speed to complete all the inventories. In all 
cities but Washington, the testing was carried out in a 
single session lasting 4 or 5 hours. In Washington, the 
officers took the tests in two sessions of about 2% hours 
each scheduled on two successive days. Each officer was 
paid $24 for participating in the test administration. 

c. Order of inventories. The untimed inventories 
were arranged so that the officers would take them in the 
following order: 

• Biographical History Information. This was placed 
first because it is quite easy and straightforward to 
fill in. The questions bearing on personal history are 
generally innocuous. We also expected that bio- 
graphical information would provide a rich yield of 
valid items. Thus, it seemed best.to have the offi- 
cers complete that inventory while they were still 
''fresh," before test-taking fatigue had set in. 

• Situational Judgment Inventory, Since the Situa- 
tional Judgment Inventory contained items derived 
directly from actual job experiences reported by 
police officers, we believed its administration 
would help to maintain continued interest and moti- 
vation in the testing situation. The examinees could 
see the relevance of these situational items and 
would be less likely to be **tumed off by the 
testing session. 

• Opinion and Self -Description Inventory, Part 11, 
Officers were urged to take a coffee break after 
finishing the Situational Judgment Inventory. We 
placed the OSDI (Part II) in position to be taken 
immediately'after the opportunity to relax over cof- 



fee. The OSDI was the longest inventory and, of 
course, contained potentially the most onerous and 
seemingly irrelevant content. Our administrators 
were entirely straightforward in warning the officers 
that this would be the most ''burdensome" of the 
inventories, but that they should just '*bear with it" 
and try not to dwell at length on any single re- 
sponse. 

• Inventory of Likes and Dislikes, 

• Opinion and Self-Description Inventory, Part /. 

• These were placed last because they are shorter and 
relatively much easier to complete than the OSDI 
Part IL The preference inventory, in particular, is 
once again quite innocuous and easy to fill in. Thus, 
these two reasonably short, innocuous, and easy 
inventories were placed in position where the ac- 
cumulated test-taking fatigue among the officers 
would have least effect on their attentiveness and 
overall rapport. [Though the OSDI, Part I, was 
initially designed to be a "warmup" inventory in 
preparation for the later, more lengthy tests, we 
found its use as a "wrapup" inventory to have 
greater utility.] 

2. Performance Ratings, 

a. Rating materials. The Job Performance Descrip- 
tion Booklets containing rating guidelines, dimension 
definitions, and performance scales for each of the four 
police jobs are contained in Appendix A. As can be seen, 
the first four pages include: (1) a rather detailed statement 
about some of the difficulties inherent in rating job per- 
formance; (2) a listing of the particular performance di- 
mensions to be used for the officers being rated; (3) 
instructions for recording ratings on a special work sheet; 
and, (4) a section detailing "things to guard against" or 
sources of error that can contribute inaccuracy to ratings.* 

As implied above, in addition to the Job Performance 
Description Booklet, each rater received a set of rating 
woric sheets, one for each of the performance dimensions 
to be rated. Figure 2 shows one such work sheet (for 
Sergeants' Job Category A: Concern for Subordinates). 
The use of this work sheet is explained in the following 
section. 

b. Obtaining ratings. Rating sessions were 
scheduled with small groups of senior officers who had 
been designated by department officials as having good 
knowledge of the job performance of the persons to be 
rated. When ratings were obtained for supervisory per- 
sonnel, sergeants, and especially middle coimnand offic- 

*The **things to guard against** section included comments designed 
to help the raters guard against halo error, making ratings based on 
limited observations, stereotype error, and^ tendencies to ignore the 
definitions provided for each of the job performance dimensions. ; 
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CONCERN FOR SUBORDINATES 

Showing concern for subordinates; being considerate; taking personal interest in their problems; giving recognition 
when deserved; using human relations principles; filling in for subordinates who have special problems; being aware of 
subordinates* needs and feelings. 

OFFICERS RATED 1 2 3 4 5 6 7 8 9 



Figure 2. Rating Worksheet for Sergeants* Job Category A: CONCERN FOR SUBORDINATES. 



ers, our staff member often conducted a rating session 
with just one or two persons-rfrequently in the senior 
officer's own office setting. By providing such individual 
attention and guidance (**hand holding"), we hoped to 
assure excellent rapport and attentiveness in the rating 
situation. Before handing out the rating materials, our 
staff member** gave a brief 15 or 20 minute talk about 
the project, its importance, its magnitude, and the abso- 
lutely crucial importance of accurate performance ratings 
to the overall success of the venture. In addition, the talk 
included comments about problems and sources of error 
in performance rating and a careful explanation of how 
we had developed special behaviorally anchored perfor- 
mance description scales in order to help overcome most 
of these sources of error. 

The Job Performance Description Booklets were then 
distributed. The raters were asked to read the explanatory 
pages of their Job Perform/uice Description Booklets and 
to study briefly the actual scales to be used in rating their 
subordinate officers. After allowing time for questions 
and further clarification, the rating work sheets were 
distributed. In some departments, we had been able to 
identify with some precision the subordinate officers who 



**ln some instances, PDl staff members trained department officials 
"^to conduct the rating sessions. In eveiy case, they used an approach 
identical to the one described above. 
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were to be rated by each senior officer. In those in- 
stances, we wrote the names of the persons to be rated in 
the appropriate blanks on each officer's set of rating 
work sheets. Rating officers were asked to read the 
names of the persons listed and to cross off the names of 
any whom they believed they did not know well enough 
to rate. In addition, they were asked to add the names of 
any subordinate whom they did know well and whom 
they wanted to rate. [We believed it wise to have such 
persons added even though they might not have been 
tested. In this way, each rating officer would be reporting 
on the entire range of job performance levels of all 
persons known to him rather than tlie potentially some- 
what restricted range of just the persons who had taken 
the test batteries.] 

It was not possible in many departments to identify 
ahead of time exactly which subordinate officers were to 
be rated by each senior officer. In those instances, rosters 
or persons who had taken the tests were distributed along 
with the rating work sheets. Rating officers were asked to 
examine the rosters and to write in the names of ail 
persons whom they believed they knew well enough to 
rate. We were intent, of course, upon obtaining more 
than one rating for as many of the tested officers as 
possible in order to examine the degree of interrater 
agreement (reliabilities} on the various scales. Our prac- 
tice of distributing rosters of examinees to the raters 
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allowed us to obtain more such multiple ratings than 
would otherwise have been the case. Rating officers were 
then instructed to consider the job performance dimen- 
sions one at a time, to rate all officers on a single 
dimension, to go on to the next dimension, rate all 
officers on it, and so on until all dimensions had been 
considered and all officers rated. They recorded their 
ratings simply by marking the appropriate blank on the 
nine- step scale for each of the officers being rated. 

c. Reactions so the rating process. The rating 
piocess obviously was time-consuming and difficult. 
Nonetheless, the job performance scales were greeted 
almost uniformly with enthusiasm. Our strategy of defin- 
ing different levels of performance with real incidents of 
poiice job behavior made this rating task more interesting 
and considerably more acceptable to the senior officers 
than is typically the case with seemingly simpler but less 
carefully defined rating scales. 

As shown in Table 2, performance ratings were ob- 
tained for a total of 2,004 officers. As mentioned, how- 
ever, ratings were obtained for many officers who were 
not tested. Similarly, they were not obtained for several 
officers who were tested. Thus, the actual number of 
officers for whom test responses could be compared with 
performance ratings was considerably below 2,004. 
These matters are dealt with in the sections that follow. 

F. Analysis of Performance Ratings 

1. Overview of analysis and findings. In spite of the 
pains taken to obtain the best possible information about 
police officers' job performance, statistical analyses 
were required to examine the overall quality of the rat- 
ings actually obtained. Two major sets of analyses were 
carried out. 

First, interrater agreement was examined for each rat- 
ing dimension separately according to ratings obtained 
from each of the cooperating departments. As is detailed 
below, these analyses of the reliabilities of the ratings 
showed large differences from city to city and between 
various performance dimensions in the relative quality of 
the ratings. As a result, decisions were made (described, 
in detail below) to delete certain performa:^xe ratings 
from further analysis. 

After discarding the ratings of low quality, the second 
major form of statistical analysis was carried out. This 
consisted of an examination via factor analysis of the 
dimensionality of the performance rating correlation 
matrices for the four police jobs. Had we been entirely 
successful in developing conceptually distinct job per- 
formance dimensions, we could expect relatively low 
intercorrelations between the various dimensions on 
which the officers were rated. On the other handrto the 
extent that the dimensions were either not distinct or the 



defining scales incapable of yielding ratings free from 
halo error, a dimensional analysis would show only a 
single general factor. As is detailed below, these factor 
analyses showed that halo error was not overcome with 
any satisfying degree of success. Only a few of the job 
performance dimensions for each of the police jobs ap- 
peared to be sufficiently distinct statistically to justify 
thdr retention for further analysis. 

Methods of analysis, results obtained, and decisions 
madr; concerning the criterion data are described in tiie 
two following, sections: Reliability Studies and Dimen- 
sional Analyses. ; ^ 

2. Reliability studies. Our study of the interrater 
agreement for various scales and different departments 
used ratings for all persons as opposed to using only 
those for persons with test information. We reasoned that 
estimates based on the broader range of persons would be 
more representative of the scales in actual use than those 
based on ratings for only those persons who had been 
tested. 

Interrater reliability coefficients were computed by 
estimating the ratio of differences between raters rating 
the same subordinates to differences for raters rating 
different subordinates. Essentially, this involves comput- 
ing the ratio between rater agreement and rater disagree- 
ment and is a variant of the intraclass correlation coeffi- 
cient (Ebel, 1951). In a general way, the measure of 
interrater agreement can be expressed as: 

Interrater variance within ratings given to jointly 

l_ rated ratees 

Variance of mean ratings given to all ratees 

Computationally, the numerator of the ratio in the 
above expression is the pooled within- set variance across 
all groupings of jointly rated subordinates. The de- 
nominator is simply the total variance across all ratees' 
mean ratings or dimension **scores"— whether based on 
just one rating or on multiple ratings. If all raters agree 
completely for every jointly rated subordinate, the value 
of the ratio becomes 0 and the reliability will equal 1 . If 
the differences between different raters' evaluations of 
the same person are as large as the differences between 
the ratings given to all persons, the index will equal 0, 
the scale is completely unreliable, and our confidence in 
the statistical stability of any rated differences between 
two or more persons is put to a severe test. If rated 
performance differences between subordinates are very 
large relative to the average amount of disagreement for 
an individual subordinate, the errors are sufficiently 
small so that they are unlikely to affect the general 
stability of the ordering of the ratees, and the ratings can 
be used with confidence to distinguish effective perfor- 
mers from less effective performers for test validation 



12 



33 



purposes. The above line of reasoning outlines our 
rationale for examining the interrater reliabilities of the 
performance ratings as a way of identifying and discard- 
ing from further analysis any ratings of such low quality 
as to cause us to seriously question their usefulness for 
test validation purposes. 

a. Patrol officer ratings. Table 3 shows the numbers 
of patrol officers who were rated by various numbers of 
raters. Needless to say, we were surprised to note that a 
few officers had been rated by so many persons. It 
seemed unlikely that as many persons as five or six 
would be equally well qualified to rate the job p)erfor- 
mance of any single patrol officer. We suspected that the 
reliabilities of ratings for persons with high numbers of 
multiple ratings would, therefore, be low. The re- 
liabilities of multiple ratings were examined separately 
according to city, and our expectations generally were 
confiitncd. For example: 

• Reliabilities for nine Washington officers with five 
or more ratings were unifonnly low. 

• Reliabilities for four Cincinnati officers with five or 
more ratings were uniformly low. 

• Reliabilities for 1 1 Portland officers with three rat- 
ings were uniformly low. 

• Reliabilities for two Des Moines officers with three 
ratings were uniformly low. 

Because we have no good way of identifying which 
raters were the more qualified to rate the above 26 offic- 
ers, we decided simply to delete their performance rat- 
ings from any further analyses. 



Table 4 

Interrater Reliability Estimates* for Job Performance Ratings for All Patrol Officers 
(N = 886**) 

Estimate Based on 
Estimate B^tsed on Spearman-Brown 
Overall ' Raters with Two Correction to 

Dimension Estimate Ratings Only (N=288) Two Raters (K=2) 



A Crime Prevention 


53 


53 


50 


B Use of Force 


48 


44 


46 


C Traffic Control 


47 


49 


45 


D Public Safety 


43 


39 


41 


E Investigation 


48 


47 


46 


F Report Writing 


50 


53 


48 


G Ethical Conduct 


37 


29 


34 


H Dealing with Public 


37 


48 


35 


I Domestic Disputes 


37 


26 


35 


J Commitment 


55 


55 


53 


K Teamwork 


53 


48 


51 


L Overall Rating 


67 


72 


65 


Sum of All Ratings 


64 


66 


61 



Mean Number of 

Raters (K) 2.20 2.00 



*Decinuiis omitleJ. 

••Twcnly^six of?^xr^ with extmneiy unrt liable muttipk ratings have been deleted from this analysis. 



T^ablcs 4-10 show estimates of reliabilities for each of 
the patrol officer dimensions for ail cities together and 
separately for each of the cities. As will be noted, three 
estimates are given for each dimension. The estimates in 
the first column of each of the tables are computed from 
all availableinformation, including officers with just one 
rating, as well as those with multiple ratings. This means 
that the pooled within variance across jointly rated sub- 
ordinates (numerator) is based on fewer subjects than the 
between variance based on all ratees* mean "scores** 
(denominator). The reliability estimates in the first col- 
umn are the best estimate for the stability of the actual 
**scores** for each officer on each dimension, but they 



Table 3 




Numbers of Patrol Officers Whose Job Performance Was 


Rated by 7, 2, i, Ere. Raters 


Number of Raters 


Number of Ratees 


1 


329 


2 


288 


3 


132 


4 


104 


5 


45 


6 


7 


7 


2 


8 


3 


9 


I 


10 


0 


11 


1 




912 



34 



13 



Table 5 

Interrater Reliability Estimates* for Job Performance Ratings for Cincinnati Patrol 

Officers 









Estimate Based on 






Estimate Based on 


Spearman-Brown 




Overall 


Raters with Two 


Correction to 


Dimension 


Estimate 


Ratings Only (N=74) 


Two Raters (K=2) 



A Crime Prevention 

B Use of Force 

C Traffic Control 

D Public Safety 

E Investigation 

F Report Writing 

G Ethical Conduct 

H Dealing with Public 

I Domestic Disputes 

J Commitment 

K Teamwork 

L Overall Rating 
Sum of All Ratings 

■ Mean Number of 
Raters (K) 

*Decim»U omitted. 

••Four offlcers with cjiixcmely umelitWe moUiple nrting* have been delcteil from t*ii» inalysii. 



52 


66 


49 


36 


29 


34 


55 


58 


52 


31 


31 


28 


52 


66 


49 


50 


57 


47 


24 


-12 


22 


45 


56 


42 


39 


30 


37 


61 


68 


59 


53 


58 


51 


63 


81 


60 


62 


72 


59 



2.25 2.00 



Table 6 

Interrater Reliability Estimates* for Job Performance Ratings 
for Des Moines Patrol Officers 
(N =114**) 









Estimate Based on 






Estimate Based on 


Spearman-Biown 




Overall 


Raters with Two 


Correction to 


Dimension 


Estimate 


Ratings Only (N=51) 


Two Razers (K=2) 



A Crime Prevention 
B Use of Force 
C Traffic Control 
D Public Safety 
E Investigation 
F Report Writing 
G Ethical Conduct 
H Dealing with Public 
1 Domestic Disputes 
J Conunitment 
K Teamwork 
L Overall Rating 
Sum of All Ratings 



23 

29 
-38 

13 
-42 

08 
-31 

20 
-23 
-33 
-06 

27 

01 



Mean Number of Raters (K) 1.45 



33 
52 

-03 
35 

-16 
29 

-03 
51 

-24 

-16 
02 
37 
25 

2.00 



29 
36 
00 
18 
00 
11 
00 
25 
00 
00 
00 
34 
01 



'DecimAls oroKted. 

••Two oflkeri with exiiemdy umtlitbte multipl* ratings hive been deleted fma ihii wtlyiii. 
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Table 7 



Inter rater Reliability Estimates* for Job Performance Ratings 
for Miami (Dade County) Patrol Officers 
(N --98) 



Estimate Based on 







Estimate Based on 


Spearman-Brown 




Overall 


Raters with Two 


Correction to 


Dimension 


Estimate 


Ratings Only (N^48) 


Two Raterc (1C^'}\ 


A Crime Pi«vention 


•41 


-27 


00 


B Use of Force 


-05 


14 


00 


C Traffic Control 


31 


39 


37 


D Public Safety 


14 


13 


17 


E Investigation 


03 


15 


04 . 


F Report Writing 


26 


37 


32 


G Ethical Conduct 


42 


57 


49 


H Dealing with Public 


51 


54 


58 


I Domestic Disputes 


10 


-19 


13 


J Commitment 


28 


14 


34 


K Teamwork 


09 


-04 


12 


L Overall Rating 


73 


76 


78 


Sum of All Ratings 


48 


48 


56 


Mean Number of Raters (K) 


1.50 


2.00 





*DeciRMts amined. 



Tablb 8 

interrater Reliability Estimates* for Job Performance Ratings 
for Mirmeapolis Patrol Officers 
(N = 238) 



Estimate Based on 



Dimension 


Overall 
Estimate 


Estimate Based on 
Raters with Two 
Ratings Only (N»29) 


Spearman-Brown 

Correction to 
Two Raters (K =2) 


A Crime Prevention 


64 


30 


53 


B Use of Force 


68 


84 


57 


C Traffic Control 


48 


-07 


36 


D Public Safety 


45 


29 


.34, 


E Investigation 


56 


64 


. . '44'' ''v •'■ 


F Report Writing 


53 


64 


41 


G Ethical Conduct 


47 


25 


35 


H Dealing with Public 


44 


11 


..:33: .■ 


I Domestic Disputes 


51 


27 


39 


J Commitment 


56 


73 


■ . ■■44 ■ 


K Teamwork 


49 


56 


37 


L Overall Rating 


70 


78 


59 


Sum of All Ratings 


70 


70 


59 


Mean Number of Raters (K) 


3.25 


2.00 





*Dedinab omitted. 
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Table 9 



Ir/erraier Reliability Estimates* for Job Performance Ratings 
for Portland Patrol Officers 
(N = 130*V 









Estimate Based on 






Estimate Based on 


Spearman- Brown 




Overall 


Raters with Two 


Correction to • 


Dimension 


Estimate 


Ratings Only (Nb37) 


Two Raters (K=2) 


v^nnic rTcvcnuun 


OH 


82 


64 


B Use of Force • 


47 


35 


47 


C Traffic Control 


62 


61 


61 


D Public Safety 


42 


56 


41 


E Investigation 


57 


67 


56 


F Report Writing 


46 


60 


46 


G Ethical Conduct 


25 


46 


25 


H Dealing with Public 


36 


47 


35 


1 Domestic Disputes 


24 


54 


25 


J Commitment 


59 


88 


59 


K Teamwork 


51 


66 


50 


L Overall Rating 


70 


84 


70 


Sum of All Ratings 


67 


78 


66 . 


Mean Number of Raters (K) 


2.00 


2.00 





*Decimais omined. 

**Eleven officen with extientely unreliable multiple rtfings have been deleted from this analysis. 



Table 10 



Interrater Reliability Estimates* for Job Performance Ratings 
for Washington Patrol Officers 
(N = 164**) 











Estimate Based on 








Estimate Based on 


Spearman-Brown 






Overall 


Raters with Two 


Correction to 




Dimension 


Estimate 


Ratings Only (N==49) 


Two Raters (K«2) 


A 


Crime Prevention 


31 


62 


33 


B 


Use of Force 


22 


29 


24 


C 


Traffic Control 


18 


47 


20 


D 


Public Safety 


14 


• 21 


15 


E 


Investigation 


13 


23 


14 


F 


Report Writing 


29 


60 


31 


G 


Ethical Conduct 


25 


29 


26 


H 


Dealing with Public 


-07 


19 


00 


1 


Domestic Disputes 


00 


00 


00 


J 


Commitment 


42 


43 


44 


K 


Teamwork 


26 


43 


28 


L 


Overall Rating 


43 


55 


45 




Sum of All Ratings 


33 


56 


35 




Mean Number of Raters (K> 




2.00 





*DecinuUs omined. 

**Ntne offlccn with extreme^ unreliable ratings have been deleted fn>m this analysis. 
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may be somewhat imprecise (probably somewhat overes- 
timated) because of the computational anomaly men- 
tioned above. 

The estimates in the second column are computed for 
officers who were actually rated by exactly two raters. 
The estimates in the third column were derived by using 
the Spearman-Brown formula to correct the first column 
estimates to a base of K = 2; that is, a statistically 
corrected estimate based on the hypothetical condition 
where each ratee is assumed to have been rated by 
exactly two raters. City-to-city comparisons of estimated 
i^eliabilities for various dimensions are best made by 
comparing the estimates given in columns two and three, 
since they both have essentially the same base of two 
raters per ratee. 

As can be readily noted from Tables 4^10, re- 
liabilities axe generally acceptable for all dimensions for 
the cities of Cincinnati, Minneapolis, and Portland. They 
are considerably poorer and many are clearly unaccepta- 
ble for the departments in Des Moines, Miami, and 
Washington. We decided to discard from further 
analyses the ratings of lowest quality and to recompute 
overall reliability estimates across all cities for those sets 
of data that were most reliable. The following decisions 
were made: 

• Ratings for Des Moines officers on dimensions C, 
E, G, I, J, and K were discarded. 

• Ratings for Miami officers on dimensions A, B, D, 
E, I, J, and K were discarded. 

• Ratings for Washington officers on dimensions D, 
E, H, and I were discarded. 



New reliability estimates were then recomputed across 
all cities for the remaining information. In this instance, 
however, we computed reliabilities for only those offi- 
cers for whom test information was available. We 
reasoned simply that reliability estimates should be ob- 
tained, at this stage, for only those ratings to be used as 
criterion scores in generating item validity statistics. 
Table 11 shows the final reliability estimates for tested 
patrol officers for each of the dimensions (with data 
discarded as specified above) across all cities. In general, 
the reliabilities are acceptable, though in some instances 
(notably for dimensions D, E, and I) quite severe reduc- 
tions in sample size were necessary in order to achieve 
higher and more acceptable values. 

b. Detective ratings. Multiple ratings were used much 
less frequently for detectives than for patrol officers. 
Table 12 shows the distributions of multiple ratings for 
detectives. Data for the two detectives rated by four 
persons were deleted from further analyses. 

Reliability estimates were computed for each of the 
detective dimensions for all cities together and sepa- 
rately for each of the cities. In the interest of saving 
space, tables showing the separate reliability estimates 
for each city are given in Appendix B. However, Table 
13 shows the reliability estimates for detective dimen- 
sion ratings for all detectives taken together. Dimensions 
A, B, C, D, the Overall Rating, and the S'jm of Ratings 
show reasonably good reliabilities. Fortunately, these 
dimensions are exactly the ones which seem intuitively 
to be most important in the overall job of investigation. 
In contrast, dimensions E, F, G, H, I, J, K, and L show 
low reliabilities. Examining the separate reliability esti- 



Table 11 

Interrater Reliability Estimates* for Retained Job Performance Ratings for All Tested 

Patrol Officers 



Dimension 



Overall Estimate 



Estimate Based on Ratees 
with Two Ratings Only 







N 


r 


N 


r 


A 


Crime Prevention 


618 


57 


202 


58 


B 


Use of Force 


626 


54 


202 


46 


C 


Traffic Control 


591 


53 


195 


55 


D 


Public Safety 


465 


46 


153 


41 


E 


Investigation 


363 


60 


106 


67 


F 


Report Writing 


702 


52 


242 


52 


G 


Ethical Conduct 


593 


40 


194 


31 


H 


Dealing with Public 


542 


4S 


193 


59 


1 


Domestic Disputes 


360 


53 


106 


28 


J 


Commitment 


522 


64 


154 


66 


K 


Teamwork 


520 


59 


155 


55 


L 


Overall Rating 


700 


71 


.242 


70 




Mean of All Ratings 


705 


68 


'242 


69 



*D«(iinals omined. 
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Table 12 

Numbers of Detectives Whose Job Performance Was 



Rased by 1,2, 3, 


& 4 Raters 


Number of Raters 


Number of Ratees 


1 


251 


2 


187 


3 


.39 


4 


^2 




485 



mates for these dimensions city by city shows that they 
were rated very poorly in almost all cities with the 
possible exception of Minneapolis and Cincinnati. 

Again, we decided to discard from further analyses the 
ratings of lowest quality and to recompute overall reli- 
ability estimates across all cities for those sets of data 
that were most reliable. The following decisions were 
made: 

• Ratings for Cincinnati detectives on dimensions G 
and L were discarded. 

• Ratings for Des Moines detectives on dimensions 
A, B, F, and L were discarded. 

• Ratings for Miami detectives on dimensions £, F, 

G, I, K, and L were discarded. 

• Ratings for Portland detectives on dimensions B, C, 
E, G, I, and J were discarded. 

• Ratings for San Diego detectives on dimensions G, 

H, J, K, and L were discarded. 



• Ratings for Washington detectives on dimensions 
E, F, G, I, J, and K were discarded. 

New reliability estimates were then recomputed across 
all cities for the remaining information. Again, these 
new estimates were computed for only those detectives 
for whom test information was available. Table 14 shows . 
the^ final reliability estimates for tested detectives for 
each of the dimensions (with data discarded as s^'tecified 
above) across all cities. In most instances, these re- 
liabilities are acceptable, but again drastic reductions in 
sample size were necess^iry for many of the 
dimensions — especially for dit^iensions E, G, I, J, K, 
and L. And, in fact, the reliabilities still are considerably 
lower than desirable for Dimension C (Interrogation), 
Dimension G (Appearing in Couit), Dimension H (Pub- 
lic Relations), Dimension I (Juvemles), and Dimension 
L (Integrity)^ 

c. Sergeant ratings. Table 15 shows the pattern of 
multiple ratings obtained for sergeants. Examiiiation of 
reliabilities according to numbers of raters showed that 
sergeants with three ratings in the cities of Portland, 
Miami, Washington, and San Diego were rated whh 
especially low reliability. Thus, ratings for a total of 12 
sergeants were discarded from further analyses: three 
from Portland, three from Miami, five from Washington, 
and one from San Diego. A total of 12 sergeants was 
tested and rated in Tucson and Albuquerque, but they 
received only one rating each and could not, therefore. 



Table 13 . 

Inter rater Reliability Estimates* for Job Performance Ratings for All Detectives 

(N = 483*V 









Estimate Based on 






Estimate Based on 


Spearman- Brown 




Overall 


Raters with Two 


Correction to 


Dimension 


' Estimate 


Ratings Only (N=187) 


Two Raters (K=2) 


A Investigating a Crime 


" 61 


66 . 


67 


B Arrest, Search, Seizure 


49 


57 


55 


C Interrogation 


46 




52 


D Investigating a Ca<;e 


54 


59 


60 


E Developing Informants 


42 


33 


48 


F Report Writing 


30 


28 


35 


G Appearing in Court 


27 


16 


33 


H Public Relations 


23 


24 


28 


I Juvenilcf, 


17 


20 


22 


J Cooperation 


43 . 


39 


49 


K Dedication 


38 


39 


44 


L Integrity 


21 


26 


26 


M Overall Rating 


56 


' 61 


• 62 


Sum of Ratings 


55 


59 


61 


Mean Number of Raters (K) 


1.55 


2.00 





^Decimals omined. 

**Two detectives with unreliable multiple mirigs have been deleted from this analysis. 
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Table 14 



Interrater Reliability Estimates* for Retained Job Performance Ratings for All Tested 

Detectives 



Estimate Based on Ratees 

Dimension Overall Estimate with Two Racings Only 





N 


r 


N 


r 


A Investigating a Crime 


377 


65 


140 


74 


B Arrest, Search, Seizure 


334 


56 


127 


64 


C Interrogation 


361 


41 


142 


46 


D Investigating a Case 


411 


53 


156 


60 


E Developing Informants 


209 


60 


79 


58 


F Report Writing 


233 


50 


76 


65 


G Appearing in Court 


104 


30 


48 


19 


H Public Relations 


297 


32 


108 


32 


I Juveniles 


178 


37 


66 


44 


i Cooperation 


219 


47 


99 


38 


K Dedication 


205 


52 


78 


55 


L Integrity 


214 


43 


75 


53 


M Overall Rating 


415 


54 


156 


63 


Mean of All Ratings 


415 


62 


156 


68 



'Cccimali unuited. 



be included separately by city in these reliability 
analyses. 

Table 15 



Numbers of Sergeants Whose Job Performance Was 
Rated by L 2, 5. Etc. Raters 



Number of Raters 


Number of Ratees 


I 


176 


2 


178 


3 


2! 


4 


8 


5 


4 


6 


3 




390 



Reliability estimates were computed for each of the 
sergeant dimensions for all cities togetl^er and separately 
for each of the cities. Tables showing separate estimates 
for each city are given in Appendix B. Table 16 shows 
the reliability estimates for sergeant dimension ratings 
for all sergeants taken together, lliough none of the 
estimates is abysmally low, neither are they outstand- 
ingly high. With the exception of a few dimensions here 
and there, only the information from Portland seemed 
almost uniformly to show low quality ratings for 
sergeants. Thus, less drastic "'surgery'" was required in 
discarding data for sergeants than was the case for patrol 
officers and detectives. The following decisions were 
made for discarding sergeants' ratings: 



• Ratings for Cincinnati sergeants on dimension D 
were discarded. 

• Ratings for Portland sergeants on dimensions A, B, 
D, £, G, and H were discarded. 

• Ratings for San Diego sergeants on dimension B 
were discarded. 

New reliability estimates were then recomputed across 
all cities for the remaining information. Again, these 
new estimates were computed for only those sergeants 
for whom test information was available. Table 17 shows 
the final reliability estimates for tested sergeants for each 
of the dimensions (with data discarded as specified 
above) across all cities. Surprisingly, the estimates 
shown in Table 17 are about the srime size as those 
shown in Table 16. Most of the reliabilities are margi- 
nally acceptable. None is so low as to rule out continued 
study of the dimensionality of the performance ratings, 
I though dimensions A and E approach levels of useless- 
ness in their reliabilities. 

d. Middle Command personnel, , For middle command 
ratings, the only necessary deletion of information was 
for two persons with four ratings each from Washington. 
Of the remaining 215 middle command officers, 65 were 
in departments where no one received more than one 
rating from a senior officer (no multiple ratings for mid- 
dle level personnel were obtained from Cincinnati, San 
Diego, Tu'^.son, or Albuquerque); thus, reliability esti- 
mates are available separately for only five cities. Tables 
showing separate estimates for these'five cities are given 
in Appendix B. Table 18 shows the reliability estimates 
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for middle command dimension ratings for all middle 
level personnel taken together. With the exception oif 
dimension C (Scheduling) and dimension H (Public Re- 
lations), the reliabilities are reassuringly high. Even so, 
cities varied somewhat in the reliabilities of the 
ratings— sufficiently to suggest the wisdom of again dis- 
carding some ratings from further analyses. The follow- 
ing decisions were made: 



• Dimension H was unreliably rated in all cities. 
Therefore, all dimension H ratings were discarded 

^ from further analyses. 

• Ratings for Des Moines middle level officers on 
dimensions B, E, F, and G were discarded. 

• Ratings for Miami middle level officers on dimen- 
sions C and G were discarded. 



Table 16 

Interrater Reliability Estimates* Jor Job Performance Ratings for All Sergeants 

(N ^ 379*V 

Estimate Based on 









Estimate Based on 


spearman-Brown 






Overall 


Raters with. Two 


Correction to 




Dimension 


Estimate 


Ratings Only (N»178) 


Two Raters (K=2) 


A 


Concern for,.Subordinates 


37 


38 


41 


B 


Coordination and Deploy- 


46 


48 


50 




ment r 








C 


Supervision ^r. 


51 


59 


55 


D 


Administration and 


45- . 


49 


49 




Inspectioo 








E 


Decision Making and 


34 


37 


38 




Initiative 








F 


Training and Planning 


52 


54 


57 . 


0 


Dedication 


40 


48 


44 


H 


Public Contact 


40 


49 


44 


1 


Overall Rating 


57 


64 


61 




Sum of Ratings 


58 


63 


62 




Mean Number of Raters (K) 


1.70 


2.00 





*DecinMlt ofnitted. 

**Ekven lergeants with unreliable multiple ratings have been deleted from this analysis. 



Table 17 

Interrater Reliability Estimates* for Retained Job Performance Ratings for All Tested 

Sergeants 



Estimate Based on Ratees 

Dimension Overall Estimate with Two Ratings Only 







. N 


r 


N 


r 


A 


Concern for Subordinates 


350 


35 


165 


38 


B 


Coordination and Deploy- 


298 


51 


141 


55 




ment 










C 


Supervision 


359 


48 


?70 


59 


D 


Administration and 


284 


M9 


125 


54 




Inspection 










E 


Deciiion Making Initiative 


349 


29 


165 


36 


F 


Training and Planning 


363 


53 


172 


53 


G 


Dedication 


352 


44 


167 


47 


H 


Public Contact 


352 


42 


167 


49 


1 


Overall Rating 


362 


57 


172 


63 




Mean of All Ratings 


365 


58 


172 


64 



^Decimals omitted. 



• Ratings for Minneapolis middle level officers on 
dimension E were discarded. 

• Ratings for Washington middle level officers on 
dimension I were discarded. 

New reliability estimates were then recomputed across 
all cities for all ratings for middle level officers who also 
had been tested. Results are shown in Table 19. The 
reliabilities of middle level officer ratings are acceptable, 
with the exception of those for dimension C (Schedul- 
ing). Ratings on dimension D (Training), dimension E 
(Supervision), and dimension G (Field Command) are 
only marginally acceptable. 



e. Summary of reliability results. Table 20 sum- 
marizes the reliability estimates for those ratings retained 
for use in additional analyses. The median values are all 
in the same range and are acceptably high. Ratings of 
Overall Performance and the Mean of All Ratings Given 
(which may be viewed as another form of overall per- 
formance index) show high reliabilities for all police 
jobs. Finally, in each job, the four dimensions with 
highest reliabilities are exactly those dimensions for each 
job which appear intuitively to represent the most impor- 
tant and most readily observable aspects of police per- 
formance. This, is particularly true for the detective and 
sergeant jobs. 



Table 18 

Interrater Reliability Estimates'^ for Job Performance Ratings for All Middle Level 

Officers (N = 215) 



Estimate Based on 
Estimate Based on Spearman-Brown 
Overall Raters with Two , Correction to 

Dimension Estimate Ratings Only (N-S8) Two Raters (K=2) 



A 


Administrative 


56 


72 


65 


B 


Commuurcations 


53 


67 


63 


C 


Scheduling 


30 


43 


39 


D 


Training 


48 


57 


58 


E 


Supervision 


45 


50 


55 


F 


Subordinate Evaluation 


59 


68. 


68 


G 


Field Command 


43 


32 


53 


H 


Public Relations 


02 


20 


03 


1 


Dedication 


45 


50 


55 


J 


Overall Performance 


58 


55 


67 




Sum of Ratings 


64 


71 


73 




Mean Number of Raters (K) 


1.35 







'Decimals omitted. 



Table 19 

Interrater Reliability Estimates* for Retained Job Performance Ratings for All Tested 
-J Middle Level Officers 



Estimate Based on Ratees 
Dimension Overall Estimate with Two Ratings Only 







N 


r 


N r 


A 


Administrative 


204 


'59 


56 73 


B 


Communications 


186 


52 


48 62 


C 


Scheduling 


172 


30 


46 44 


D 


Trmning 


204 


43 


56 56 


L 


Supervision 


158 


48 


36 65 


r 


Subordinate Evaluation 


186 


56 


48 67 


G 


Field Command 


150 


42 


38 02 


H 


Public Relations 


—deleted — 


— deleted — 


1 


Dedication 


157 


52 


40 53 


J 


Overall Performance 


204 


55 


56 54 




Mean of All Ratings 


206 


65 


56 72 



"Decimals omitted. 
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Table 20 



Median Reliability Estimates, Dimensions With Highest Reliabilities, and Reliabilities for Overall Rating and Mean of 

Ratings for Retained Performance Ratings 



Patrol Officers 

Median Reliability: 
Overall Performance: 
Mean of All Ratings: 
Highest Dimensions 

Commitment: 

Investigation: 

Teamwork: 

Crime Prevention: 

Sergeants 

Median Reliability: 

Overall Performance: 

Mean of All Ratings: 

Highest Dimensions 
Training and Planning: 
Coordination and Deployment: 
Administration and Inspection: 
Supervision: 



.54 
.71 

.68 

.64 
.60 
.59 
.57 



.49 
.57 
.58 

.53 
.51 
.49 
.48 



Detectives 

Median Reliability: 
Overall Performance: 
Mean of All Ratings: 
Highest Dimensions 
Investigating a Crime: 
Developing Informants: 
Arrest, Search, Seizure: 
Investigating a Case: 

Middle Uvel Officers 

Median Reliability: 
Overall Performance: 
Mean of All Ratings: 
Highest Dimensions 

Administration: 

Subordinate Evaluation: 

Communications: 

Dedication: 



.51 
.54 
.62 

.65 
.60 
.56 
.53 



.52 
.55 
.65 

.59 
.56 
.52 
.52 



3. Factor analytic studies, A major reason for carry- 
ing out the rather extended surgical procedures described 
in the preceding pages wa& to **clean up the performance 
ratings** sufficiently to allow us to place confidence in 
results from dimensional analyses of them. We wished to 
factor analyze the intercorrelation matrices based on per- 
formance ratings in order to reduce the necessary number 
of ditnensions at the item analysis stage of our studies. 
Thus, as described* we discarded performance ratings of 
low quality in order to maximize the statistical stabilities 
of correlations between pairs of dimension ratings and 
the corresponding stabilities of the subsequent factor 
matrices derived from the correlation tables. Discarding 
information had the effect, of course, of producing diffe- 
rent sample sizes for performance ratings on various 
dimensions. [For example, for patrol officers, the sample 
sizes varied from 360 for dimension I (Domestic Dis- 
putes) 10 702 for dimension F (Report Writing).] For 
computation, pairwise deletion of information was used 
so that each resulting matrix contained correlation coeffir 
cients based on different sample sizes. Tables showing 
final sample sizes, mebns and standard deviations of the 
ratings, and the correlation matrices between ratings are 
given in Appendix C for each of the four police jobs. 
Information in Appendix C includes data for only those 
officers for whom both test data and performance ratings 
;vere available. 

Correlations between all ratings and the two overall 
indices (the Overall Performance Rating and the Mean of 
All Ratings) were dropped from each of the four correla> 
tion matrices. Each remaining matrix was then factored 



beginning with multiple in the cells and iterating 
through varimax rotations to a specified number of fac- 
tors until the communality estimates stabMized. [See 
Nice, Bent, & Hall (1970) for a detailed description of 
this factor analysis routine.] Several solutions with vary- 
ing numbers of factors were examined for each police job 
before settling on one solution that seemed to portray 
most meaningfully the dimensionality of each correiation 
matrix. Results of these analyses are described below 
and on subsequent pages. 

a. Patrol officers. Results for two-factor and three- 
factor solutions for the patrol officer ratings are shown in 
Table 21. A large general factor involving Crime Preven- 
tion, Investigation, Commitment, and Public Safety is 
shown by both solutions. A second factor, shown in both 
solutions, is defined by performance dimensions (Ap- 
propriate Use of Force, Dealing with the Public, Handl- 
ing Domestic Disputes) involving direct personal 
contact between patrol officers and citizens. The third 
solution is distinctive in that Teamwork stands out as a 
useful performance dimension. And, conceptually at 
least. Teamwork is somewhat different from the core 
behavior represented by either of the first two factors. 

These results were used in conjunction with reliability 
information and knowledge of the sample sizes available 
for analysis to decide which dimensions would be used 
for item analysis purposes. We sought to choose a di- 
mension that: (1) could be regarded as a **marker*' 
dimension for the factor on which it was most highly 
loaded; (2) showed a high reliability estimate in our 
previous analyses; and (3) was based on as large a 
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Table 21 



Dimension 

A Crime Prevention 

B Use of Force 

C Traffic Control 

D Public Safety 

E Investigation 

F Report Writing . 

G Ethical Conduct 

H Dealing with the Public 

I Domestic Disputes 

J Commitment 

K Teamwork 

*Dectmalft oinined. 

**No(e: In Ihe non>rolaied solulions, Fi 



number of subjects as possible. In choosing a dimension 
to represent Factor 1, the following information was 
considered: 



Dimension N Reliability 

Crime Prevention 618 .57 

Public Safety 465 .46 

Investigation 363 . .60 

Commitment 522 .64 

In choosing a dimension to represent Factor II, the 
following information was considered: 

Dimension N Reliability 

Use of Force 626 .54 

Dealing with the Public 542 .48 
Domestic Disputes 360 .53 



Obviously, Teamwork with an N of 520 and a reliability 
of .59 was the only dimension available for representing 
Factor III. 

Using the above guidelines, we chose the following 
dimensions to serve as criterion scales against which to 
carry out item analyses for patrol officers: 

Crime Prevention, herein- 
after called: P-CRIME; 

Use of Force, hereinafter -^ : 

called: P-FORCE; 

Teamwork, hereinafter 

called: P-TEAMWORK; and, 

the Overall Rating, herein- 
after called: P-OVERALL. 

b. Detectives. Table 22 shows results for three- and 
four-factor solutions for the correlation matrix based on 
detective performance ratings. A massive general factor 



JlL 

69 
63 
55 
68 
81 
55 
37 
72 
77 
66 
73 



consists of the intuitively most important detective di- 
mensions. The second factor is a curious blend of Integ- 
rity and Dealing with Juveniles. Factors ni and IV are 
specific to the dimensions of Public Relations and Report 
Writing, respectively. The major decision here was to 
select the best possible dimension to serve as the 
**marker" for the big general factor. Here is the relevant 
information for that decision: 



Dimension 


N 


Reliability 


Investigating a Crime 


377 


.65 


Arrest, Search, Seizure 


334 


.56 


Interrogation 


361 


.41 


Investigating a Case 


411 


.53 


Developing Informants 


209 


.60 


Dedication 


205 


.52 



For Factor II, the following were relevant: 

Dimension N Reliability 

Juveniles ng .37 

Integrity 214 .43 

The reliability of Public Relations dimension ratings was 
only .32, too low to be considered further. However, the 
reliability of Report Writing dimension ratings was an 
accepuble .50, based on 233 subjects. 

Again, using guidelines of sample size, level of reliabil- 
ity, and factor definition, the following dimensions were 
chosen to serve as criterion scales against which to carry 
out item analyses for detectives: 

Investigating a Crime, here- 
inafter called: D-INVESTIQATE; 

Integrity, hereinafter 
called: D-INTEGRITY; 
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Factor Matrices* for Two-Factor and for Three-Factor Solutions 
for Job Performance Ratings for Patrol Officers 



Two-Facior Solution** 



11 



h* 



60 
57 
56 
68 
79 
55 
37 
70 
77 
67 
54 



Three-Factor Solution** 



n 



lU 



10 
-03 
28 
43 
28 
24 
21 
38 
36 
36 

d 



■tcior I accounted for 87.3* and 83.3% of the common variance respectively in Ihe iwo-facior and three- factor soluUont. 
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Table 22 

Factor Matrices'^ for Three-F actor and for Four-Factor Solutions 
for Job Performance Ratings for Detectives 









Three-Factor Solution 








Four-Factor Solution** 






Dimension 


I 


II 


III 


h= 




I 


11 


III 


IV 


h* 


A 


Invescigaiing a Crime 


78 


18 


30 


73 




76 


17 


15 




73 


B 


Arrest, Search, Seizure 


70 


17 


42 


69 




68 


12 


26 


37 


68 


C 


Interrogation 


60 


39 


23 


57 




66 


22 


43 


02 


67 


D 


Investigating a Case 


72 


26 


31 


68 




72 


19 


23 


28 


68 


E 


Developing Informants 


63 


46 


07 


62 




63 


44 


14 


07 


62 


F 


Report Writing 


43 16 


mi 


53 




36 


18 


19 


m 


64 


G 


Appearing in Court 








Deleted 


Due \ 


0 


Low N(104) 








H 


Public Relations 


24 


47 


44 


47 


23 


24 


[toI 


18 


64 


I 


Juveniles 


22 


w\ 


13 


66 




26 




37 


00 


60 


J 


Cooperation 


34 


43 


1^ 


66 








52 


38 


63 


K 


Dedication 


EH 


36 


39 


75 


1 


i 


if 


27 


36 


75 


L 


Integrity 


22 


57 


28 


45 




17 




15 


30 


66 




Percent of Variance 84.9% 10.0% 


5.2% 




79.4% 9.9% 


5.5% 


5.3% 





*DccimaU omilled. 

••Note: In ihe n«n-rolatcd solutions. Fuclor I accounied for W,9<* and 79.4^ of Ihc common variance respectively In the three- factor and four- factor solutions. 



Report Writing, herein- 
after called: D-REPORTING; and. 

Mean of All Ratings, here- 
inafter called: D-OVERALL. 

c. Sergeants. Ratings for sergeants yielded an even 
larger and more pervasive general factor than those for 
patrol officers and detectives. Even so, a three-factor 
solution was meaningful. It is shown in Table 23. Using 
essentially the same bases for decisions here as for the 
patrol officers and detectives, the following dimensions ' 
were chosen to serve as criterion scales against which to 
cairy out item analyses for sergeants: 



Training and Planning, 
hereinafter called: 

Supervision, hereinafter 
called: 

Administration and In- 
spection, hereinafter 
called: 

Overall Performance Rat- 
ings, hereinafter called: S-OVERALL. 



S-TRAINING; 



S-SUPER VISION; 



S-INSPECTION;and, 



d. Middle level command officers. The four-factor 
solution provided the most clear-cut picture of the dimen- 
sionality of the criterion ratings for middle level command 
personnel. Results are shown in Table 24. Again, the first 
factor is pervasive, accounting for a very substantial 
portion of the common variance. The dimensions loading 
highest on Factor I are similar in that they involve the 
guidance and training of subordinates. Factor n has high- 
est loadings on dimensions involving departmental ad- 
ministrative and scheduling activities. Dedication is most 



strongly represented on Factor III. Factor IV has highest 
loadings on the interactive behaviors of Communications 
and Supervision. Evidence related to our final choices of 
dimensions for item analysis purposes is shown in the 
following: 





Dimension 


N 


Reliability 


Factor I: 


Training 


204 


.43 




Subordinate Evaluation 


186 


..56 


Factor 11: 


Administrative 


204 


.59 




Scheduling 


172 


.30 


Factor IV: 


Communications 


186 


.52 




Supervision 


158 


.48 



Based on the above information, the following dimen- 
sions were chosen to serve as criterion scales against 
which to carry out item analyses for middle level offi- 
cers: 

Administrative, hereinafter 
called: C-ADMINISTRATIVE; 

Communications, herein- 
after called: C-COMMUNICATIONS; 

Subordinate Evaluation, here- 
inafter called: C-PERSONNEL; 

Dedication, hereinafter 
called: C-DEDICATION; and. 

Mean of All Ratings, here- 
inafter called: C-OVERALL. 

e. Summarizing comment. The most obvious fea- 
ture of the factor analytic results for all four police jobs is 
the presence of massive general factors in all four sets of 
performance ratings. It is apparent that our efforts to 
overcome halo error through painstaking development of 
behaviorally anchored job peiformance scales met with 
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Table 23 



Factor Matrix* Showing Three-Factor Solution 
for Job Performance Ratings for Sergeants 

Three-Factor Solution** 



Dimension 


I 


II 


m 


h* 


A Concern for Subordinates | 


il 


1 44 


10 


52 


B Coordination and Deployment 


34 


[ssl 


42 


59 


C Supervision 


27 




44 


68 


D Administration and Inspection 


29 


35 


m 


64 


E Decision Making and Initiative 


36 


Ozl 


25 


52 


F Training and Planning 


m 


27 


47 


61 


G Dedication 




31 


29 


53 


H Public Contact { 




1 22 


30 


56 


"Decimals omitted. 










**Notc: In the. non rotated solutiun. Factor 1 accounted for 88.9% of the common variance. 







Table 24 



Factor Matrix* Showing Four-Factor Solution 
for Job Performance Ratings for Middle Level Command Officers 

Four-Factor Solution** 





Dimension 


I 


II 


ni 


IV 


h' 


A 


Administrative 


39 




18 


22 


60 


B 


Communications 


45 


29 


21 


HD 


61 


C 


Scheduling 


20 


HD 


36 


26 


62 


D 


Training 


n 


31 


25 


18 


57 


E 


Supervision 


25 


36 


31 


EH 


52 


. F 


Subordinate Evaluation 




21 


24 


27 


65 


G 


Field Command 


47 


25 


45 


21 


54 


I 


Dedication 


25 


24 


na 


19 


42 



'Decimals omitted. 

**Note: In the non rotated solution. Factor 1 accounted for 86.1 <X< of the common variance. 



little success. Most raters apparently formed overall im- 
pressions about the relative effectiveness of the officers 
they were rating and allowed these global impressions to 
color their ratings on all the other performance rating 
■ scales. 

A major problem in obtaining job performance ratings 
for police officers is that superior officers usually have 
only a limited opportunity to make firsthand, on-the-job 
observations bf bow their subordinates are going about 
their jobs. They rely most often upon reports from the 
fields and these may suffer from all sorts of problems 
ranging from incompleteness to actual distortion, either 
unintentional or intentional. Perhaps peer ratings would 
have yielded more distinct behavioral descriptions of job 
performance. Certainly they would have been based 
more fully on actual firsthand obseivations of police job 
performance. 

Unfortunately, peer evaluations could not be obtained 



in these studies. We found that most departments were 
most comfortable with the traditional concept of 
superiors rating subordinates, and they felt very uneasy 
about the notion of co-workers rating each others' job 
performance. Landy and Goodin (1974) imply that peer 
evaluation may become more conunon in the years ahead 
as the trend toward greater personal professionalism con- 
tinues to develop in law enforcement agencies. We hope 
this may be true. Our experience suggests that the 
superior ratings we obtained were heavily influenced by 
global perceptions'of job effectiveness. We believe peer 
perceptions of co-workers* job activities in police work 
will almost always be based on broader observational 
opportunities. They should, therefore, be much less 
overwhelmed by global judgments of job effectiveness 
than our ratings were. 

In spite of the large general factors shown by correla- 
tion tables based on each of the four sets of ratings, the 
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factor solutions also showed fairly meaningful additional 
factors. In each instance, the general factor seemed to be 
comprised mostly of performance dimensions possessing 
intuitive appeal as the most salient for the particular job 
being rated. Thus, for patrol officers. Crime Prevention, 
Public Safety, Investigation, and Commitment were 
heavily represented on Factor I. For detectives. Inves- 
tigating a Crime; Arrest, Search, and Seizure; Interroga- 
tion; Investigating a Case; IDeveloping Informants; and 
I>edication were heavily represented on Factor L For 
sergeants. Concern for Subordinates, Training and Plan- 
ning, Dedication, and Public Contact were heavily repre- 
sented on Factor I. For middle level officers, the first two 
rotated factors bore high loadings from dimensions of 
Training, Subordinate Evaluation, Administration, and 
Scheduling. The lesser factors for each of the four solu- 
tions add further interpretive meaning to the above 
highly salient activities. Recognizing that these lesser 
factors are weakly defined and to a large degree indistinct 
from the general factor, we decided nonetheless to atr 
tempt to develop separate prediction keys for them. 
Table 25 summarizes the performance ratings we finally 
decided upon for use in the item analyses described in the 
next section. 

G. item Analysis and Development of Pre- 
dictor Scales 

1 . General overview of analyses. The tests and inven- 



tories administered to participating police officers in- 
cluded the following: 

• EAS Tests 1,4,7, and 10 

• Biographical History Information: 149 

items 



Opinion and Self-Description Inventories: 



473 
items 



• Likes and Dis'^.kes Inventories: 

205 items for patrol officers 
213 items for detectives 

195 items for supervisory officers (sergeants and 
middle level command) 

• Situational Judgment Inventories: 

86 items for patrol officers 

90 items for detectives 

97 items for sergeants 

88 items for middle level officers 
Results obtained for the EAS tests are given in a later 
section. The present section describes the method of 
analysis used to develop scoring keys likely to be predic- 
tive of the various criterion dimensions mentioned in 
Table 25 of the immediately preceding section. The 
pools of items chosen for item analysis included those 
listed above with one further modification. In examining 
the items of the Biographical History Inventory, we 
noted that two distinctly different types of items could be 



Table 25 

Dimensions Chosen for Item Analyses; Reliabilities; and Numbers of Tested Officers for 





Whom Ratings 


WereiAvailable 






Criterion 


Number of 


Reliability 




Scale 


Tested Officers 


of 




Designation 


Rated 


Ratings 


Patrol Officers: 


P-CRIME 


618 


.57 




P-FORCE 


626 


.54 




P-TEAMWORK 


520 


.59 




P-OVERALL 


700 


.71 


Detectives: 


D-INVESTIGATE 


377 


.65 




D-INTEGRITY 


214 


.43 




D.REPORTING 


233 


.50 




D-OVERALL 


415 


.62 


Sergeants: 


S-TRAINING 


363 


.53 




S-SUPERVISION 


359 


.48 




S-INSPECTION 


284 


.49 




S-OVERALL 


362 


.57 


Middle Level Officers: 


C-ADMINISTRATIVE 


204 


.59 




C-PERSONNEL 


186 


.56 




C-DEDICATION 


157 


.52 




C-COMMUNICATIONS 


186 


.52 




C.OVERALL 


206 


.65 



26 



47 



identified. A first group of items portrayed descriptions 
of actions actually taken at some time in the past. Exam- 
ples of such items include: 

13. Did you ever accept a full-time job where the 
salary was less than your previous job? 

1. yes 

2. no 

41. What size high high school did you attend? 

1. fewer than 100 students 

2. 100-499 students * - 

3. 500-999 students 

4. 1,000-2,000 students 

5. more than 2,000 students 

48. Where did most of your spending money come 
from during the years you were in high School? 
1 « allowance from family 

2. my own earnings 

3. partly allowance, partly earnings 

4. other sources 

5. had no spending money 

. A total of 56 items of this type was identified. 

A second group consisted of a mix of somewhat more 
subjective items, including current practices, impres- 
sions of things in the past, attitudes, expectations, etc. 

Examples of such items include: 

23. How much did your parents emphasize success 
and getting ahead to you? 

1. constantly 

2. frequently 

3. now and then 

4. rarely 

5. never ' 

71. Which of the following is most likely to make 
you feel more uncomfortable or unhappy? 

1. having a friend not speak to you 

2. making a mistake in your work 

3 being laughed at when some circumstance 

makes you look silly 
4. having to introduce yourself to someone 
you don't know 
1 19. Do you consider yourself as: 

1. nervous 

2. fairiy tense 

3. fairly relaxed except when the job tension 

builds up 

4. fairly relaxed . 

5. always relaxed 

A total of 87 items of this type was identified. Since 
these two typen of items arc distinctly different, we 
decided to analyze them as separate item pools in addi- 
tion to considering all of them taken together. The first 
six items of the inventory, consisting solely of identify- 



ing information (such as age, sex, etc.), were deleted for 
purposes of item analysis. 

The following, item pools were, therefore, available 
for developing predictcj- i-^oring keys: 

lum Pool Abbreviation Number 
Biographical History Infonnation — 

PAST BIO-PAST 56 
Biographical History Information — 

MIXED BIOMIX 87 
Total Biographical History 

Information B1OT0T-- 143 
Opinion and Self-Description 

Inventories OSDI 473 

Situational Judgment Inventories SITNL 86-97 

Inventories of Ukes and Dislikes LD 195-213 

Three major series of analyses were employed in order 
to develop and select sets of predictor scoring keys for 
each set of criterion dimensions. The forms of analysis 
arc described below under the headings: **Item analysis 
and cross-validation," **Modal response keys," and 
**Factor analyses of predictor-criterion composites." 

2. Item analysis and cross-validalion. The number of 
separate items available for analysis against the various 
criterion dimensions varied from 899 for. the middle level 
command inventories to 919 for the detective inven- 
tories. When such large numbers of separate item re- 
sponses arc evaluated^ against some other variable (such 
as a criterion rating), the likelihood of ^^discovering'' 
rather large numbers of purely chance relationships is 
great. Scoring keys based on such item analyses will 
include not only items with valid and stable relationships 
with the criterion, but also an unknown number of items 
with nonstable, chance relationships. The *'foldback val- 
idity" (i.e., the correlation between a scoring key and a 
criterion rating computed on the same sample as was 
used for the item analysis) of such scoring keys is usually 
high, because the correlation coefficient between key 
scores and criterion scores reflects both the true, valid 
relationships and the chance, error-based relationships. 
When this same scoring key is applied to a new sample 
of persons, the error component disappears, and the 
key-criterion correlation is smaller. The validity coeffi- 
cient is said to *'shrink." Such shrinkage is always to be 
expected whenever a scoring key is developed to give 
n^aximum prediction within a sample of persons and is 
then applied to a different sample of persons. ^ 

It is imperative under such circumstances that the 
methods used for selecting items to be keyed also pro- 
vide a way of estimating the level of validity (cross- 
validity) to be expected when the key is applied to 
subsequent samples of persons. A traditional sh^tegy for 
providing such estimates has been the .strategy of double 
cross-validation (Katzell, 1951). Double cross-validation 
typically begins by randomly splitting the available sam- 
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pie of persons into two subsamples equal in size. Scoring 
keys are then developed separately on each subsample. 
Each key is then applied to the other subsample in order 
to estimate its cross-validity. 



Here is an example of a double cross-validation design 
used in developing scoring keys for selecting industrial 
salesmen (Bownas & Dunnette, 1975): 



Total Sales Sample 
N^^-llO 
(Item Pool 1) 



Scoring Key B 
cross-validity 
r = .27 



Sample A 

N = 55 



:3L 



Sample B 




Scoring Key A 


N = 55 




cross-validitv 




r=-.27 






• 



Scoring Key A 
Foldback r==.74 



Scoring Key B 
Foldback r=.75 



The above is an example of an ideal outcome. Both 
keys show the same degree of shrinkage and yield 
cross- validity estimates of the same magnitude. With 
such an outcome, we can confidently estimate the degree 
of shrinkage and the likely usefulness of the keys for use 
in selection of future candidates for selling. 



Unfortunately, double cross-validation designs rarely 
yield such unambiguous outcomes. A far iTiore frequent 
pattern is shown below: 



Total Sales Sample 
N=110 
(Iicem Pool 2) 







1 ^ 








Scoring Key B 
cross- validity 
r = .20 




Sample A 
N = 55 




Sample B 

N=55 




Scoring Key A 
cross-validity 
r=~.05 



Scoring Key A 
Foldback r=^.80 



Scoring Key B 
Foldback r:=. 77 
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Here, one is hard put to decide exactly what to do. 
Key B might be viewed as showing modest usefulness, 
but since Key A **wa8hcd out" completely, one must 
remain uncertain about the actual usefulness of any key 
based on this particular item pool and sample of persons. 
In effect, a problem with double cross-validation is that 
the single split of the total sample, even though random, 
may still yield distinctly different subgroups of persons. 
In itself, this is not a disadvantage, because one purpose 
of cross-validation is to determine exactly what may 
happen to a scoring key's validity when it is applied to 
different subjects. However, it would be desirable to 
carry out several separate random splits and to compute 
cross-validity coefficients on many split samples instead 
of only one as In the double cross-validation design. The 
median value the several cross- validity coefficients 
would provide a more certain estimate of the amount of 
shrinkage to be expected than the single pair of cross- 
validity estimates generated by the fortuitous cir- 
cumstances of just the single random split of the typical 
double cross-validation approach. 

This line of reasoning led us to develop a Mo te Carlo 
procedure for examining the cross-validities of the scor- 
ing keys developed in these studies. The procedure be- 
gins by splining the total sample randomly into two 
subsamples of equal size. A scoring key is developed in 
one of the samples.* Its foldback validity is determined 
on that subsample and its cross- validity determined on 
the other subsample. The subsamples are then recom- 
bined to form the total sample which is split again ran- 
domly into two equal-sized subsamples, a key de- 
veloped, foldback and cross-validities computed, sub- 
samples recombined, split anew, a key developed, 
foldback and cross- validities computed, and so on and so 
on through as many ** realizations" of the process as may 
be necessary to achieve stability of the distributions of 



•The weights for the scoring key ire determined as follows. First, 
the criterion dimension ratings are converted to a standard score dis- 
tribution with Mean = 50 and Standard Deviation = 10. All response 
options are then examined to determine the proportion of persons 
making each response and to compute the mean criterion scores of 
persons within each response category. A decision is made prior to 
each computer run to give positive unit weights to response categories 
where the mean criterion score exceeds a certain value (e.g., 52.5 or 
51.5 or 51.0) and negative unit weights to response categories where 
the mean criicricn score ritlts below a certain value (e.g., 47.5 or 48.5 
or 49.0). Also, a prior constraint is set so that no response category will 
be weighted if fewer than some small proportion (say 5% or 10%) of 
persons have given responses in that category. Here are some examples 
of how scoring weights would be assigned for various response dis- 
tributions to items with the typical L/it* (L), Indifferent (I)» or Dislike 
(D) format of cur Likes and Dislikes Inventories: 

1. N « 200 persons 

2. No weight given for categories with fewer than 10% of the total 
responses. 



validity coefficients being computed. In our use of this 
Monte Carlo routine, we find that 15 realizations are 
sufficient to yield a stable estimate of the median cross- 
validity of a series of scoring keys developed according 
to specified criterion limits. The numbers of responses 
receiving scoring weights depends, of course, on the 
mean criterion score limits chosen ahead of time. If only 
a small deviation (e.g., 49.0 or 51.0) from the overall 
mean of 50.Q is required for a response to be weighted, 
relatively many responses will receive scoring weights. 
However, if a larger difference (e.g., 47.0 or 53.0) is 
required tor a response to be weighted, relatively few 
responses will receive scoring weights. Keys differing in 
length also will differ in their reliabilities and these, in 
tum, affect the levels of shrinkage shown on cross- 
validation. The median cross- validities for keys de- 
veloped from different criterion score limits and for dif- 
ferent item pools are compared. The particular set of 
limits yielding the least shrinkage is then used in the total 
sample to fix scoring weights for the item pool that is 
being analyzed. Fixing final scoring weights on the basis 
of the total sample statistics is best because of increased 
statistical stability gained from the larger sample size. 

Since our Monte Carlo procedure examines the stabil- 
ity of keys based on many random sample splits instead 
of just one, it is especially well adapted for developing 
keys in the type of situation we faced in this project. 
Police officers from many different cities were tested and 
rated. A single random split might not represent the 
special features of all cities equally; by using the Monte 
Carlo procedure, with its multiple realizations, scoring 
keys made up of items showing systematic validity dif- 
ferences from city to city would tend not to yield good 
cross-validities. Such keys would tend to be dropped 
from further consideration. Thus, as mentioned, the pro- 
cedure has the special advantage of discovering scoring 
keys that are likely to generalize across different settings 
and different subjects in their levels of validity. 

Through the median cross-validitif;s derived from the 
Monte Carlo routine constitute good (but prob ibly con- 
servative) estimates of the expected use^ness of our 
scoring keys, the fact of examining several possible keys 
and choosing those few with the highest median cross- 
vaiidities could still be argued to involve some element 
of optimization (that is, some distributions of cross- 
validities may be high simply by chance and could, 
therefore, occasionally yield partially spurious results). 
We decided to attack this potential problem by construct- 
ing four special criterion scales, designed with the same 
means and standard deviations as the OVERALL per- 
formance scales for each of the four police job areas. For 
each job area, the distribution of scores for ratees on the 
OVERALL criterion dimension were reassigned ran- 
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Item Examples n 



Mean 
Criterion 
Score 



47.5-52.5 



Criterion Limits 
48.5-51.5 



49.0-5 >.0 



I 



L 


100 


50.5 


NO 


NO 




I 


50 


51.3 


WEIGHTS 


WEIGHTS 




D 


50 


49.1 


I 


I 


+ 1 


L 


14 


46.0 


proportion too small 


proportion too small 


proportion 


I 


150 


50.5 








D 


36 


48.9 






-1 


L 


30 


53.0 


+ 1 


+ 1 


+ 1 


I 


40 


47.2 


-1 


-1 


-1 


D 


130 


50.5 








L 


70 


52.1 


I 

NO 


+ 1 


+ 1 


I 


50 


50.2 


WEIGHTS 




-1 


D 


80 


48.6 


I 







domly to the officers in each of the four samples. The 
reassignments were accomplished by a computer using a 
random number source. This pr^ess yielded four sets of 
pseudo-ratings with score distributions identical to those 
of the OVERALL distributions but composed entirely of 
random error. By definition, the randomly assigned val- 
ues of this scale could not be correlated with true perfor- 
mance (since they were randomly defined, they could not 
be correlated with anything). Thus, as we proceeded to 
carry out our item analyses for each of the item pools 
against the various criterion dimensions, we also carried 
out identical analyses against each of the four randomly 
generated pseudo-criterion dimensions. Our hope, of 
course, was that the median cross-validities for all scor- 
ing keys developed against the RANDOM distributions 
would be very close to 0. This is because such scoring 
keys presumably would contain only items with nonsta- 
ble chance relationships and essentially no items with 
truly valid and stable relationships. Any sharp departures 
from 0 would be worrisome and might well cause us to 
question the rationale underlying our Monte Carlo pro- 
cedures. 

3. Modal response keys. We have just described the 
basic methodology we employed for developing and 
selecting empirically weighted scoring keys based on 
item analyses against criterion performance ratings. The 
procedure was used with all available item pools. How- 
ever, we also reasoned that experienced police officers 
would show certain modal responses to most items on the 
Situational Judgment Inventories. In other words, certain 
actions would be regarded by most officers as "^correct" 
or desirable and certain actions would be regarded as 
""incorrect" or undesirable. Scoring keys based on the 
modal response patterns of all the officers who com- 
pleted these inventories were developed for each of the 
Situational Judgment Inventories. We hypothesized that 



officers scoring high on such keys were, in effect, de- 
monstrating that they were more fully aware of the **cor- 
rect" actions to be taken in different police situations 
than those scoring low. Thus, scores on such modal 
response keys should be correlated positively with vari- 
ous facets of job performance as shown by criterion scale 
ratings. 

We reasoned similarly in developing modal re- 
sponse keys fOi the Likes and Dislikes Inventories. Here, 
we hypothesized that officers scoring high on such keys 
were, in effect, demonstrating preferences more sUnilar 
to police officers in general than officers scoring low on 
such keys. Thus, here too, scores might be expected to 
be correlated positively with various facets of rated job 
performance as shown by criterion scale ratings. Appen-^ 
dix D shows the decision rules that were programmed for 
the computer so that modal response keys could be gen- 
erated automatically for the four Situational Judgment 
Inventories and the three Likes and Dislikes Inventories. 

4. Factor analyses of predictor-criterion composites. 
After the best scoring keys had been selected for each of 
the criterion dimensions within a job area, the keys were 
scored for all the officers in that job area. Correlation 
coefficients between all possible pairs of scores (both 
predictor scales and criterion ratings) were computed and 
the resulting correlation matrix factor was analyzed, lliis 
was done in order to discover scoring keys which showed 
relatively large amounts of common variance so that 
such keys could be combined to form pTesumably more 
reliable and stable predictors for use in the final forms of 
the POUCE CAREER INDEX. 

5. Item pools and criterion limits for item analyses. 
Computer time required to generate cross-validity esti- 
mates by the Monte Carlo routine described previously 
increases rapidly as ^iie number of items in the item pool 
increases. In the interest of computer cost efficiency, we 
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decided; therefore, to divide the OSDI items approxi- 
mately hito thirds for item analysis purposes. We already 
have described the division of biographical items accord- 
ing to examination of their content. The item pools 
available for analysis, therefore, included the following 
for each criterioii dimension (The numbers in parenth- 
eses are the approximate number* of items in each item 
pool]: BIO-PAST (56), BiaMIX (87), BIO-TOT (143), 
LD (200), SITNL (100), OSDI 1 (165), OSDI 2 (155), 
OSDI 3 (155). Four different criterion limits were estab- 
lished for the analysis of each item pool. These were 
47.5 or 52.5; 48.0 or 52.0; 48.5 or 51.5; and, 49.0 or 
51.0 Thus, for each criterion dimension, a ioXal of 32 
Monte Cario rui^i^ was carried oiu, 32 scoring keys de- 
veloped, and their median cross-validities computed. In- 
cluding the four RANDOM pseudo-criterion dimen- 
sions, a total of 21 criterion dimension distributions was 
available for these item analyses. 

Six hundred seventy-two Monte Carlo runs were made 
across item pools (8), criterion score limits (4), and 
criterion dimensions (21). Information developed from 
these 672 computer runs (i.e., numbers of items per 
scoring key, foldback coefficients, and median cross- 
validities) is shown in the 21 tables of Appendix E. 

The more general results obtained from these item 
analyses, results with the modal response keys, and the 
outcomes of the factor analyses are ^ven below and on 
subsequent pages for each of the four police functions 
studied. 

a. Patrol officers. Correlations between the LD and 
SrrNL modal response keys and each of the criterion 
dimensions for patrol officers are shown in Table 26. 
Correlations shov^m there are small. There is possibility 
that the LD key might, in combination with other keys, 
have some predictive usefulness. More is said about this 
later. 

For patrol officers, 160 Monte Carlo runs were made, 
32 for each of the five criterion distributions. Complete 
information for all these runs is shown in Appendix E. 
The following guideUnes were used as a basis for decid- 
iz^ which scoring keys to retain for further study: 

• The median cross- validities were first examined. 
Keys with relatively high values were, of course, 
among the most likely candidates for retention. 

• The number of items meeting tlie criterion score 
limits for a given item pool for the RANDOM 
criterion dimension can be regarded as a rough 
estimate of the number of items to be expected 
strictly by chance. Deagnate this number with the 



«Tlie actual ntmboB difTered slighdy, of course, for the different job 
fttnctkmi md acooidiag to dittributkms of lespoaies shown by respon- 
dents on the OSDI items. 



symbol Nr. Presumably, the number of iteims meet- 
ing the same criterion dimension (e.g. , OVERALL) 
ought to be larger (since valid and stable items will 
be included along with those that are due only to 
chance). Designate this number with the symbol 
• Nc. The ratio Nr/Nc is an index showing which 
scoring keys contain relatively fewer valid, stable, 
nonchance items. In fsst^ the magnitudes of median 
cross-validities for various keys correlated —.59 
with the size of the Nr/Nc index. Thus, a second 
basis for choosing keys was to choose keys corres- 
ponding to the lowest Nr/Nc ratios. 
• Finally, other things being equal» relatively shorter 
keys were chosen as opposed to keys with very 
large numbers of items. This guideline is definitely 
of lesser importance. Nonetheless, it is based on the 
desire to retain a reasonable degree of simplicity in 
the final scoring systems for the CAREER INDEX. 
Also, keys with many items typically would be 
derived from less rigorous criterion score limits and 
seem intuitively to contain fewer really "good" 
items than keys based on more rigorous criterion 
score limits. As will be seen, this guideline wat> 
relaxed in a few instances, particularly in our 
examination of keys developed from BIO items for 
the middle level conunand officers. 

Table 26 

Correlation Coefficients Between tD and SITNL Modal 
Response Keys and Criterion Dimension Raiings for 
Patrol Officers 



Modal Response Key 


Criterion Dimension 


LU 


SFTNL 


P-CRIME (N =• 618) 


.16 


.10 


P-FORCE (N - 626) 


.00 


-.02 


P.TEANfWORK (N = 520) 


.16 


.05 


P^VERALL (N = 700) 


.15 


.10 


P-RANDOM (N = 700) 


.01 


-.01 



Table 27 summarizes results for the keys identified as 
best according to the above guidelines for the patrol 
officer criterion dimensions. Since several of the. keys 
shown in Table 27 were based on subseL of the total 
OSDI item pool of 473 items, wa decided to cany out 
additional Monte Carlo runs with all OSDI itents. These 
runs resulted in hevv OSDI keys for each o^tte four 
patrol officer criterion dimensions. Also note that the key 
with lowest median cross-validity for P-6vERALL is 
the one based on tte Situational Judgment Inventory. 
The Situational Judgment Inventory presents a, difficult 
isst^e if used to screen inexperienced i^licaiits. They 
haivc had no experience in police woric. Thus, the test— 



for applicants — could be criticized as unfair. These con- 
siderations led us to drop the SITNL key from further 
consideration for police officers. The inventory could 
perhaps still be of some use as a training and evaluation 
i::^?tniment during police academy training, however. 

The patrol officer scoring keys finally selected for 
further study via factor analysis arc listed in Table 28. 
Table 28 shows all relevant statistics including odd-eyen 
reliability estimates for each of the keys and statistics 
obtained for keys based on the same item pool with 
corresponding criterion score limits against 
P-RANDOM. 

In order to study more fully the dimensionality of the 
'^n scoring keys and the five criterion distributions (in- 
cluding the pseudo-criterion: RANDOM), a 15 X 15 
correlation matrix was computed and factor analyzed. A 
four-factor solution was chosen for inteq)retation be- 
cause the Random variable showed low loadings on all 
four factors. (The Random variable received a high load- 
ing on Factor V in the five-factor solution^ suggesting 
that a strictly error factor had emerged at that stage of 
factoring.) Table 29 shows that factor matrix for the 
four-factor solution. The factor matrix shows that 



metliod variance very nearly overwhelms the correlations 
between individual predictor scales and corresponding 
criterion dimension ratings. Factor II is defined most 
strongly by the four OSDI keys. Factor IV is defined by 
two of the three Likes and Dislikes keys. Highest load- 
ings on Factor in are from the four criterion scales. Only 
Factor I seems to define predictor and criterion variance 
cutting across different inventories and criterion ratings. 
These results are compelling in suggesting that certain 
scoring keys be combined. We decided, therefore, to 
reduce the number of predictor scoring keys for patrol 
officers from ten to four as follows: 

• Since the OSDI (Force) key was the only one 
selected in analyses against the P-FORCE criterion 
scale, it was retained as a single scoring key and 
designated PI. v 

• The remaining OSDI scoring keys were combined 
to form a single key designated PII. 

• The two Likes and Dislikes keys loading high on 
Factor IV were combined and designated PHI. . ' 

• The three keys loading most highly on Factor I 
[BIO-TOT (Teamwork), LD (Teamwork), BIO- 



Table 27 



Initial Scoring Keys Chosen for Patrol Officer Criterion Dimensions: Criterion Score 
Limits, Numbers of Items, Foldback Coefficients, and Median Cross-Validities 



Criterion 
Score , 
Limits 



Number of 
Items Weighted 



Foldback 
Coefficient 



Median 
Cross- 
Validity 



P'CRIME 
BIOTOT 
LD 

OSDI 1 
OSDI 2 

P'FORCE 
OSDI 2 
OSDI 3 



48.5-51.5 
48.5-51.5 
49.0-51.0 
48.5-51.5 



49.0-51.0 
48.5-51.5 



56 
52 
31 
30 



31 
30 



.46 
.43 
.37 
.34 



.37 
.34 



.16 
.19 
.15 
.16 



.15 
.16 



P'TEAMWORK 

BIOTOT 48.5-51.5 70 .47 • .21 

LD 48.5-51.5 60 .51 .23 

OSDI 2 49.0-51.0 42 .42 .16 

OSDI 3 48.5-51,5 50 .33 ^21 

P'OVERALL 

BIOTOT 48.5-51.1 50 .45 .23 

LD 48.5-51.5 46 .43 .22 

SITNL 48.5-51.5 64 .54 ..17- 

OSDI 1 49.0-51.0 44 .39 .23 

OSDI 2 49.0-51.0 47 .37 .23 

OSDI 3 48.5-51.5 43 .29 .19 

P RANDOM iNO KEYS SHOWED ACCEPTABLE LEVELS OF CROSS-VALXDrTY] 
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Table 28 

Scoring Keys for Patrol Officer Criterion Dimensions: Relevant Statistics for Keys and for Similar Keys Against 

P'Random 





Criterion 
Score 
Limits 


Number 
of Items 
Weighted 


Odd-Even 
Reliability 


Foldback 
Coefficient 


Median 
Cross- 
Validity 


Number 
of 
Items 


P-Random 

Foldback 
Coefficient 


Median 
Crass- 
Validity 


P'CRIME 














• 




BIOTOT (Crime) 


48.5-51.5 


56 


.55 


.46 


.16 


30 


.37 


.02 


LD (Crime) 


48.5-51.5 


52 


.63 


.43 


.19 


23 


.36 


.03 


OSDI (Crime) 


48.5-51.5 


39 


.71 


.39 


.17 


14 


.27 


.01 


P'FORCE 


















OSDI (Force) 


49.0-51.0 


71 


.78 


* .39 


.19 


• 14 


.27 


.01 


P-TEAhmORK 


















BIOTOT (Teamwork) 


48.5-51.5 


70 


.68 


.47 


.21 


30 


.37 


.02 


LD (Teamwork) 


48.5-51.5 


60 


.54. 


.51 


.23 


23 


.36 


.03 


OSDI (Teamwork) 


48.5-51,5 


50 


.80 


.33 


.21 


12 


.28 


.03 


P'OVERAU 


















BIOTOT (Overall) 


48.5-51.5 


50 


.70 


.45 


.23 


30 


" .37 


.02 


LD (Overall) 


48.5-51.5 


46 


.60 


.43 


.22 


23 


.36 


.03 


OSDI (Overall) 


48.5-51.5 


86 


.90 


.38 


.24 


41 


..31 


.00 


Median Values 




52 


.68 


.43 


.21 


23 


.36 


.02 



Table 29 



Factor Matrix for Four-Factor Solution* of Scoring Key-Criterion Dimension Matrix for 

Patrol Officers 



Scoring Keys 




11 


m 


IV 




BIOTOT (Crime) 


EE 


-.0 


14 


42 


55 


LD (Crime) 


-33 


-27 


16 


n 


77 


OSDI (Crime) 


-23 




16 


28 


83 


OSDI (Force) 


12 




27 


-01 


82 


BIOTOT (Teamwork) 


-83 


-19 


03 


-l^i 


74 


LD (Teamwork) 


-71 


-05 


10 


19 


55 


OSDI (Teamwork) 


-31 


EID 


-05 


05 


75 


BIOTOT (Overall) 


h74| -30 


04 


26 


70 


LD (Overall) 


-40 


-23 


14 


ii 


74 


OSDI (Overall) 


-23 




12 


13 


91 


Criterion Dimensions 












P-CRIME 


-31 


-06 


IS 


30 


75 


P-FORCE 


20 


-21 




-06 


64 


P-TEAMWORK 




1 


51 


-16 


70 


P-OVERAU. 


-43 


-14 




17 


80 


P-RANDOM 


10 


01 


-01 


35 


13 , 


Total Variance 


3.29 


3.22 


2.13 


1.74 


10.38 



^DectnuOs omitted. 
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TOT (Overall)] were combined and designated 
PIV. 

Reliabilities have been computed for these four final 
keys. Their median cross-validities have also been esti- 
mated by the mathematical procedure described in a 
techiiical "^hote in Appendix F. Finally, the keys have 
been correlated with each of the criterion rating oimen- 
sions. Results of all these computations are shown in 
Table 30. Intercorrelations between the four predictor 
scales are shown in Table 31. 

b. Detectives. Correlations between the LD and 
SITNL modal response k^ys and each of tlie criterion 
measures for detectives are shown in Table 32. Obvi- 
ously, the correlations are coo small to he of aI^:y use for 
predicting performance effcctiven>*iss for detectives. 

One hundred sixty Monte Carlo runs also were made 
for detectives, 32 for tach of the five criterion distribu- 
tions. Again, complete information for these runs is 
given in Appendix E. The same steps were followed in 
selecting a preliminary set of scoring keys for detectives 
as those already described in detail for patrol officers. 
The detective scoring keys finally selected for further 
study via factor analysis are shown in Table 33 along 



Predictor 
Scale 



PI 502 78 19 18 

PII 452 93 26 29 

PHI 528 76 23 41 

PIV 372 82 28 37 



*DcciinaU omitted. 



Table 31 



Intercorrelations* BetYften Predictor Scales Comprising 
the Patrol Officer Career Index 





PI 


pn 


pni 


PIV 


PI 




72 


22 


16 


PII 


72 




45 


43 


Pin 


22 


45 




49 


PIV 


16 


43 


49 





"Dectmalt omitted. 



with all relevant statistics for each of Uie keys. 

In order to study more fully the dimensionality of the 
seven scoring keys and the f$ve criterion distributions 
(including the pseudo-criterion: RANDOM), a 12 X 12 
correlation matrix was computed and factor analyzed. A 
three-factor solution was chosen for interpretation, again 
because the Random variable .showed low loadings on all 
three tactors. TabJe 34 shows the factor matrix for the 
three-factor solution. 

Factor I is a large general eff-^^^tiveness factor defined 
by high loadings from three of !)te biographical scoring 
keys [BIO-TOT C-nvcstigate), BIO-MIX (Reporting), 
BIO-MIX (Overall)] and the thttc corresponding criter- 
ion dimensions (INVESTIGATE, REPORTING, 
OVERALL). Interesdn^ly, Factor n appears to be 
defined by the criterion ratings on INTEGRITY and the 
two scoring keys selected against the Integrity criterion. 
The OSDI (Reporting) key shows a high loading on 
Factor in, but its low reliability (.30) seems to rule it out 
as a useful key for use in the Detective. CAREER IN- 
DEX. Finally, the LD (Reporting) key shows only mar- 
ginal communality (.42) and also quite low reliability 
(.41). Based on these results, certain keys were dis- 
carded and others combined so that the number of predic- 



40 13 24 01 

14 32 37 03 

11 28 42 04 

06 54 48 03 



Table 32 

Correlation Coefficients Between LD and SITNL Modal 
If€spo9tse Keys and Criterion Dimension Ratings for De^ 
tectives 



Modal Response Key 


Criterion Dimension 


LD 


SFTNL 


D-INVESTIGATE (N = 377) 


.01 


.10 


D-INTEGRITY (N = 214) 


.00 


-.12 


D-REPORTING (N = 233) 


.04 


-.10 


D-OVERALL (N = 415) 


.06 


.04 


D-RANIX)M(N = 415) 


.04 


-.02 



Table 30 

Reliabilities, Estimated Cross-Validities, and Correlations With Criterion Dimension Ratings 

for Four Scoring Keys (Predictor Scales) for the Patrol Officer Career Index* " 

Scale Statistics Patrol Officer Rating s 

Odd-Even Estimated _ 
N Reliability Cross-Validity CRIME FORCE TEAMWORK OVERALL RANDOM 



34 



55 



Table 33 



Scoring Keys for Detective Criterion Dimensions: 
Relevant Statistics for Keys and for Similar Keys Against D-Random 



D-Random 





Criterion 


Number 






Median 


Number 




Median 




Score 


of Items 


Odd -Even 


Foldback 


Cross- 


of 


Foldback 


Cross- 




Limits 


Weignted 


Reliability 


Coefficient 


Validity 


Items 


Coefficient 


Validity 


D'lNVESTIGATE 


















BIOTOT (Investigate) 


48.5-51.5 


69 


.63 


.57 


.20 


53 


.48 


.00 


D'lNTEGRITY 


















BIOPAST (Integrity) 


48.5-51.5 


62 


.55 


.56 


.19 


27 


.36 


-.02 


OSDI (Integrity) 


47.5-52.5 


17 


.47 


.42 


.13 


2 


.19 


.03 


D'REPOKTING 


















BIOMIX (Reporting) 


48.5-51.5 


52 ' 


.60 


.62 


.25 


24 


.40 


.02 


LD (Reporting) 


47.5-52.5 


30 


.41 


.56 


.15 


12 


.36 


-.03 


OSDI (Reporting) 


48.0-52.0 


29 


.30 


.55 


.17 


10 


.33 


-.01 


D'OVERALL 


















BIOMIX (Overall) 


49.0-51.0 


62 


.66 


.58 


.26 


49 


.48 


-.01 


Median Values 




52 


.55 


.56 


,19 


24 


.26 


-.01 



Table 34 



Factor Matrix for Three-Factor Solution* 
of Scoring Key-Criterion Dimension Matrix for Detectives 



Scoring Keys 

BIOTOT (Investigate) 
BIOPAST (Integrity) 
OSDI (Integrity) 
BIOMIX (Reporting) 
LD (Reporting) 
OSDI (Reporting) 
BIOMIX (Overall) 

Criterion Dimensions 

D-INVESTIGATE 
D-INTEGRITY 
DREPORTING 
D-OVERALL 
D-RANDOM 
TouJ Variance 



I 



1-821 

-05 
13 

EE 

-45 
-21 
F83l 



P79l 

-32 



-67 



-81 



08 
3.96 



06 



-76 

;62 

08 
17 
13 
05 



-24 

r85i 

-31 
-34 
18 
2.03 



III 

-04 
13 
-38 
-40 
-44 

EID 

-12 



13 
03 
-49 
04 
-36 
1.56 



68 
59 
54 
65 
42 
71 
70 



70 
82 
79 
78 
17 
7.55 



^Decimals omined. 



tor scoring keys for detectives was reduced froni sever: to 
two as follows: 

• The three BIO keys loading high on Factor I were 
combined and designated DI. 

• The two scoring keys loading high on Factor II were 
combined and designated DU. 



Reliabilities of predictor scales DI and DII, their esti- 
mated cross-validities, and their correlations with the 
criterion dimension ratings are shown in Tsble 35. The 
two predictor scales, DI and DII, are virtually indepen- 
dent. They correlate only .02 with each other. 

c. Sergeants, Correlations between the LD and 



56 



35 



Table 35 



Reliabilities, Estimated Cross-Validities, and Correlations With Criterion Dimension Ratings 
for Two Scoring Keys (Predictor Scales) for the Detective Career Index* 







Scale Statistics 




Detective Ratings 






Predictor 




Odd-Even 


Estimated 










Scale 


N 


Reliability 


Cross-Validity 


INVESTIGATE 


INTEGRITY REPORTING 


OVERALL 


RANDOM 


Di 


245 


82 


30 


52 


23 58 


59 


00 


DII 


263 


53 


21 


11 


62 26 


17 


-09 



*DecinuIs omitted. 



SITNL modal response keys and each of the criterion 
measures for sergeants are shown in Table 36. The corre- 
lations shown there are too small to be of any practical 
use in promotion decisions related to sergeants. 

Table 36 



Correlation Coefficients Between LD and SITNL 
. Modal Response Keys and Criterion Dimension 
Ratings for Sergeants 



Modal Response Key 


Criterion Dimensicn 


LD 


SITNL 


S-TRAINING (N = 363) 


.04 


.06 


S-SUPERVISION (N = 359) 


.06 


-.03 


S-INSPECTION (N = 284) 


.04 


-.10 


S-OVERALL (N = 362) 


. .13 


-.03 


S-RANDOM (N = 362) 


.02 


-.02 



One hundred sixty Monte Carlo runs also were made 
for sergeants, 32 for each of the five criterion distribu- 
tions. Complete information for these runs is given in 
Appendix £. The same steps were followed in selecting a 
preliminary set of scoring keys for sergeants as those 
already described in detail for patrol officers and detec- 
tives. The sergeant scoring keys finally selected for 
further study via factor analysis are shown in Table 37 
along with all relevant statistics for each of the keys. 
Information in Table 37 shows that the yield of poten- 
tially useful keys was considerably poorer for sergeants 
than it was for both patrol officers and detectives. The 
reason for this is not known. 

In order to study more fully the dimensionality of the 
five scoring keys and the five criterion distributions (in- 
cluding the pseudo-criterion: RANDOM), a 10 X 10 
correlation matrix was computed and factor analyzed. A 
two-factor solution was chosen for interpretation, again 
because the Random variable showed low loadings on 



Table 37 

Scoring Keys for Sergeant Criterion Dimensions: Relevant Statistics for Keys and for Similar Keys Against S-Random 





Criterion 
Score 
Limits 


Number 
of Items 
Weighted 


Odd-Even 
Reliability 


Foldback 
Coefficient 


III 


Number 
of 
Itans 


S-Random 

Foldback 
Coefficient 


Median 
Cross- 
Validity 


S'TRAINING 

BIOTOT (Training) 


48.0-52.0 


48 


.52 


.52 


.19 


55 


.52 


.05 


S'SVPERVISION 
SITNL (Supervision) 


48.5-51.5 


78 


.42 


.61 


.13 


65 


.58 


-.04 


S'lNSPECriON 

CIOMIX (Inspection) 


47.5-52.5 


19 


.22 


.51 


.16 


12 


.34 


.00 


S'OVERAU 

BIOTOT (Overall) 
SITNL (Overall) 


48.0-52.0 
48.5-51.5 


39 
84 


.41 
.44 


.58 
.61 


.17 
.17 


35 
65 


.52 
.58 


.05 
-.04 


Median Values 




48 


.42 


.58 


.17 


35 


.52 


.00 



57 



both factors. Table 38 shows the factor matrix for the 
two-factor solution. Factor I is a general factor cutting 
across the criterion dimension ratings and carrying high 
loadings from die two situational keys. Factor II derives 
high loadings from die biographical keys and also carries 
moderate loadings on all the criterion dimensions except 
SUPERVISION. The 19-item biographical key for IN- 
SPECTION, though loaded well on Factor II, has such 
low retiabiiity (.22) that it is not likely to be useful. 
Otherwise, the most straightforward way of forming pre- 
dictor keys was to combine the remaining two biographi- 
cal keys and the two situational keys to fonn predictor 
scales SI and SII. SI denotes the Situational Inventory 
key; SU denotes the biographical key. . 

Reliabilities of predictor scales SI and SII, their esti- 
mated cross-validities» and their correlations with criter- 
ion dimension ratings are shown in Table 39. Fortunate- 
ly, the reliabilities for predictor scales SI and Sll are 
considerably higher than any of those for the initial keys 
shown in Table 37. Each of the scales correlates well 
wich all of the criterion ratings. The two scales are. 



however^ relatively independent of each other. The cor- 
relation between them is .31. 

d. Middle level command officers. Correlations be- 
tween the LD and SITNL modal response keys and each 
of the criterion measures for middle level command 
officers are shown in Table 40. The modal response key 
for the Situational Inventory shows much promise. How- 
ever, the entire inventory contains nearly 100 items. We, 
therefore, developed a variation of the Monte Carlo pro- 
cedure which examines the distribution of correlations 
between each of the items of a test and the criterion, 
selects the best N items, and proceeds to calculate the 
cross- validities over several realizations for tests N items 
long. In addition to the usual item analyses for middle 
level command officers, we also conducted the addi- 
tional Monte Carlo runs designed to select the best subset 
of modal response scored items from the Situational In- 
ventory. In all, 204 Monte Carlo runs were made for the 
test and rating information from middle level command 
personnel. The various scoring keys finally selected for 
further study via factor analysis are shown in Table 41. 



I'ABLE 38 

Factor Matrix for Two-Factor Solution* of Scoring Key-Criterion Dimension 

Matrix for Sergeants 

Scoring Keys I II h* 



BIOTOT (Training) 
SITNL (Supervision) 
BIOMIX (Inspection) 
BIOTOT (Overall) 
SITNL (Overall) 

Criterion Dimensions 



-20 

-22 
-40 



74 
73 
48 
62 
55 



S-TRAINING 
S-SUPERVISION 
S-INSPECTION 
S-OVERALL 
S-RANDOM 
Total Variance 



-62 



-80 



-69 



-78 



04 
3.60 



-49 
-14 
-39 
-39 
-16 
2.22 



62 
67 
63 
76 
03 
5.82 



*Dccim«ls cmitied. 



Table 39 

Reliabilities, Estimated Cross-Validities, and Correlations With Criterion Dimension Ratings 
for Two Scoring Keys (Predictor Scales) for the Sergeant Career Index* 







Scale Statistics 




Sergeant Ratings 






Predictor 




Odd*Even 


Estimated 










Scale 


N 


Reliability 


Cross- Validity 


TRAINING 


SUPERVISION INSPECTION 


OVERALL 


RANDOM 


Sl 


271 


62 


19 


"45 


55 48 


59 


00 


SlI 


286 ' 


65 


22 


54 


37 40 


54 


06 



*DoctnuUs omitKd. 



58 



37 



In order to study more fully the dimensionality of the 
13 scoring keys and the six criterion distributions (in- 
cluding the pseudo-criterion: Random), a 19 X 19 
correlation matrix was computed and factor analyzed. A 
four-factor solution was chosen for interpretation, again 
because the Random variable showed low loadings on all 
four factors. Table 42 shows the factor matrix for the 
four-factor solution. 

Factor I is a large general factor with high loadings 
from biographical and OSDI scoring keys and two im- 
portant criterion dimensions (ADMINISTRATION and 
OVERALL). Of the highly loaded scoring keys, the 
OSDI keys for COMMUNICATIONS and OVERALL 
have reliabilities of only .42 and .43, respectively. Fac- 
tor II is defined almost entirely by its high loadings on 
the three modal response keys of the Situational Inven- 
tory. Factor III is a dedication factor, receiving high 
loadings from the criterion dimension DEDICATION 
and from the two keys validated against it. Finally, 
Factor IV derives its highest loading from the criterion 
dimension PERSONNEL and high loadings also from 
two of the three keys validated against it and from two 
other criterion dimensions. 



Table 40 

Correlation Coefficients Between LD and SFTNL 
Modal Response Keys and Criterion Dimension 
Ratings for Middle Level Command Officers 

Modal Response Key 



Criterion Dimension 


LD 


SFTNL 


C-ADMINISTRATIVE (N = 204) 


.13 


.25 


C-PERSONNEL (N = 186) 


.07 


.19 


C-DEDICATION (N =» 157) 


-.11 


.13 


C-CO^fIMUNlCATIONS (N = 186) 


.08 


.14 


C-OVERALL (N « 206) 


.11 


.28 


C-RANDOM (N = 206) 


-.04 


.06 



Based on these results, the following decisions were 
made for discarding some keys and combining. others to 
form five predictor scales for the middle level command 
officer CAREER INDEX: 

• The OSDI (Administration) and BIO-TOT (Ad- 
ministration) keys were combined to form a scale 
designated as CI. 

• Since the BIO-TOT (Overall) key showed moderate 



Table 41 

Scoring Keys for Middle Command Criterion Dimensions: Relevant Statistics for Keys and for Similar Keys 

Against C-Random 



C-Random 



Criterion 



Number 



Median Number 



Median 





Score 


of Items 


Odd-Even 


Foldback 


Cross- 


of 


Foldback 


Cross- 




Limits 


Weighted 


Reliability 


Coefficient 


Validity 


Items 


Coefficient 


Validity 


C'ADMINISTRATION 


















BlOTOr (Admin) 


49.0-51.0 


152 


.81 


.73 


.24 . 


136 i 


.72 - 


.04 


SITNLMODAL (Admin) 




44 


.44 


.53 


.27 


44 


.42 


.05 


OSDI (Admin) 


48.0-52.0 


41 


.63 


.59 


.23 


19 


.33 


-.14 


C'COMMUNICATIONS 


















OSDI (Comm) 


47.5-52.5 


20 


.42 


.52 


.17 


7 


;29 


-.10 


C'PERSONNEL 


















BIOMIX (Pers) 


49.0-5 LO 


74 


.65 


.63 


.19 


67 • 


.61 


-.02 


SITNLMODAL (Pers) 




44 


.49 


.51 


.24 


44 


.42 


.05 


SrrNLEMPlRlC (Pers) 


48.0-52.0 


84 


.59 


.68 


.17 


62 


.65 


-.07 


C'DEDICATION 
















.04 


BIOTOT (Dcdic) 


48.0-52.0 


90 


.75 


.76 


.30 


69 


.68 


SITNLEMPIRIC (Dcdic\ 


48.0-52.0 


87 


.66 


.65 


.17 


62 


.6.5 


-.07 


C'OVERALL 


















BIOTOT (Overall) 


49.0-5 LO 


161 


.81 


.71 


.34 


136 


.72' 


.04 


SITNLMODAL (Overall) 




44 


.49 


.60 


.30 


44 


.42 


.05 


LD (Overall) 


48.0-52.0 


59 


.82 


.54 


.17 


42 


.59 


.05 


OSDI (Overall) 


47.5-52.5 


35 


.43 


.60 


.21 


15 


.35 


-.11 


Median Values 




59 


.63 


.60 


.23 


44 


.59 


-.01 



38 



59 



Table 42 



Factor Matrix for Four-Factor Solution"^ of Scoring Key-Criterion Dimension Matrix 
for Middle Level Command Oncers 



Scoring Keys 

BIOTOT (Admin) 
SITNLMODAL (Admin) 
OSDI (Admin) 
OSDI (Comm) 
BIONWX (Pcrs) 
Sim(,MCDAL (Pcrs) 
SlTNLEMPIRlC(Pcrs) 
BIOTOT (Dcdir) 
SITNLEMPIRIC (Dcdic) 
BIOTOT (Overall) 
SITNLMODAL (Overall) 
LD (Overall) 
OSDI (Overall) 

Criterion Dimensions 

C-ADMINISTRATION 
CCOMMUNICATIONS 
C-PERSONNEL 
C-DEDICATION 
C-OVERALL 
CRANDOM 
Total Variance 



EzU 

-41 
-24 
-17 
-52 
-20 
3.99 



U 

-28 

QO 

10 
-02 
19 

CHI 

22 
12 
II 
25 

ra 

14 
03 



26 
06 
13 
07 

-24 
18 

2,79 



III 

-25 
-07 
-10 
-10 
-29 
-08 

-8f 
-39 
-21 
-15 
-17 



-II 
-II 
-II 

EH 

-31 

15 

2.68 



IV 

-20 
-09 
-09 
-14 

EH 

-35 

ElD 

-17 
-04 

-22 
-48 
-28 



-29 



-64 



•86 



-28 

21 
3.63 



69 
88 
72 
58 
60 
87 
70 
80 
70 
70 
89 
36 
70 



69 
59 
82 
83 
85 
14 
13.10 



*DecimaU omiitcd. 



loadings across all factors, it was retained as a 
separate key and was designated as CII. 
The three modal response keys were combined and 
designated as CIIL 

The BIO-TOT (Dedic) key showed high reliability 
(.75) and a high factor loading (.86) on Factor III. 
Its median estimated cross- validity was .30 as op- 
posed to the lower value of .17 for the other key 
[SITNLEMPIRIC(Dedic)] loading high on Factor 
IIL Hence, the BIO-TOT (Dedic) key was shown to 
represent Factor III and was designated as CIV. 



• Finally, the two keys loading most highly on Factor 
iV w<ire combined and designated as CV. 

Table 43 summarizes all relevant statistics for the 
various predictor scales chosen to represent promotional 
potential in relation to scores on the Middle Level G)m- 
mand PCI. Table 44 shows the correlations between the 
five command level predictor scales. 

e. Summary of predictor scale development. The 
preceding pages describe the steps taken in developing 
and selecting jpredictor scales for use in evaluating effec- 
tiveness potential for four police job areas. A total of 13 



Table 43 

Reliabilities, Estimated Cross-Validities, and Correlations With Criterion Dimension Ratings 
for Five Scoring Keys (Predictor Scales) for the Middle Level Command Career Index"^ 



Scale Statistics 

Estimated 



Middle Conunand Ratings 



Predictor 




Odd-Even 


Cross- 


ADMINIS- 


COMMUNI- 










Scale 


N 


- Rdiability 


Validity 


TRATION 


CATIONS 


PERSONNEL 


DEDICATION 


OVERALL 


RANDOM 


CI 


123 


83 


24 


76 


42 


43 


35 


65 


07 


CII 


140 


81 


34 


55 


51 


52 


48 


72 


. 01 


cm 


193 


80 


32 


40 


31 


36 


26 


48 


05 


av 


158 


75 


30 


27 


27 


31 


77 


44 


-08 


CV 


131 


74 


25 


37 


50 


74 


38 


61 


-08 



'Decimals omiRed. 



60 



39 



Table 44 

intercorrelations* Between Predictor Scales 
Comprising the Middle Command Officer Career Index 





CI 


CII 


cm 


CIV 


CV 


CI 




79 


42 


43 


50 


CI! 


79 




43 


54 


68 


cm 


42 


43 




28 


43 


CIV 


43 


54 


28 




40 


cv 


50 


68 


43 


40 





*DeCimalk omilled. 



scales has been selected, four for patrol officers, two for 
detectives, two for sergeants, and five for middle level 
command officers. Relevant information and summary 
statistics for these scales are summarized in Table 45. 

The reliabilities of these scales are adequate, and their 
correlations with the criterion rating scales are acceptable 
for prediction purposes. Most impressive are the near- 



zero correlations between the predictor scales and the 
Random distributions. This is good evidence that our 
Monte Carlo item analysis strategy was successful in 
identifying and weighting item responses showing stable 
relationships with criterion ratings, and that predictor 
scale scores, as expected, show no relationship with 
randomly generated score distribution. Finally, the 
cross-validities are of acceptable magnitude. The various 
predictor scales for each of the four police functions will 
be equally weighted and combined to yield a single 
estimate of potential in each police job function. The 
combined scores undoubtedly will be even more reliable 
and more valid than any of the median values shown in 
Table 45. Ordinarily, we would have estimated the over- 
all validiCies to be expected by using the Monte Carlo 
routine to compute multiple correlation coefficients and 
distributions of cross-validities for the combined predic- 
tor scales. Unfortunately, this could not be carried out 
here because of the varying sample sizes on which the 
predictor scale-criterion relationships are based. At any 



Table 45 

Item Content, Median Reliabilities, Median Correlations Against Criterion and Pseudo-Criterion (Random) 
Distributions » Median Estimated Cross-Validities, and Median Inter cor relations Between Predictor Scales 

Comprising Four Career Index Inventories 



CAREER INDEX 


Item 
Content 


Median 
Reliability 


Median Correlation 

Against 
Criterion Ratings 


Median Correlation 
with Pseudo-Criterion 
(RANDOM) Distribution 


Median 
Estimated 
Cros«^ 
Validity 


Median 
Intercorrelation 
Between Scales 


Patrol Officer 
PI 
PII 
PHI 
PIV 


OSDI (Personality) 
OSDI (Persoraliiy) 
LD (Interests) 
LD & BIO (Interests 
& Background) 


.80 


.30 


.03 


.24 


.44 


Detective 
DI 
DII 


BIO (Background) 
OSDI & BIO (Person- 
ality & Background) 


.67 


.39 


-.05 


.25 


.02 


Sergeant 
SI 

SII 


SITNL (Situational 

Judgment) 
BIO (Background) 


.63 


.51 


.03 


.20 


.31 


Middle Command 
CI 

CII 

cm 

CIV 

cv 


OSDI & BIO (Person- 
ality & Background) 
BIO (Background) 
SITNL (Situational 

Judgment) 
BIO (Background) 
SITNL & BIO (Situa- 
tional Judgment & 
Background) 


.80 


.44 


.01 


.30 


.43 



40 



61 



rate, the median cross-validities of .24, .25, .20, and .30 
should be regarded as minimum estimates of the val- 
idities to be expected when the CAREER INDEX inven- 
tories are put into actual operational u>c. 
The interested reader may wish to refer to Appendix 

G. There, we have included a sampling of the items and 
corresponding response scoring weights for each of the 
predictor scales summarized in Table 45. Examining 
these illustrative items should give the reader an intuitive 
sense of the patterns of personal preferences, attitudes, 
opinions, and background characteristics related to effec- 
tive and ineffective pcrtbrmance in patrol officer, detec- 
tive, sergeant, and middle command functions. 

Based on the weights for the few sample items shown 
there, higher rated patrol officei^ appear to be thoughtful 
and analytic, persistent, civic minded, confident, atten- 
dant (sensitive) to criticism, were accorded leadership 
status when young, and are physically active yet relaxed 
in their manner. Higher rated detectives appear to have 
been **involved" in high school but no/ highly sociable 
or affiliative. They are intent on gathering much informa- 
tion before making decisions, and they have no apparent 
difficulty in taking orders. Higher rated sergeants possess 
a definite self-perception of success, and they show a 
strong interest in work, valuing it in its own right instead 
of as merely a means to an end. Higher rated middle 
command officers are strongly achievement oriented, 
like people, emphasize work and effort, were active in 
school and held leadership posts while there, and proba- 
bly have had some college education. 

H. Rating, Predictor Scale, and Validity In- 
formation According to Cities and Sub- 
£:roups 

1 . Performance ratings, 
a. Tested versus non-tested officers. Recall that 
considerably more patrol officers were rated in the c ; 
of Minneapolis and Portland than the number who finuiy 
took the experimental test battery. This was done as a 
way of forming a crude estimate of the relative represen- 
tativeness of the level of job performance shown by the 
tested officers. Table 46 shows the means, standard de- 
viations, and t values for Portland and Minneapolis pat- 
rol officers on the patrol officer job performance dimen- 
sions. Three of the mean differences shown in Table 46 
are sufficiently large to be regarded as statistically stable. 
However, in Minneapolis, the tested officers received 
ratings slightly lower than the officers who were rated 
but not tested. Just tlie opposite was the case in Portland, 
where the officers who appeared for testing weie higher 
rated on the average than those who were rated but not 
tested. Since the magnitudes of the differences are not 
lai;ge (in no case exceeding half a standard deviation) and 



:^ince the differences are in opposite directions, we could 
come to no firm ^conclusions about the nature of biasing 
effects, if any, in our tested samples. Thus, we let the 
matter remain a mystery and prcx:eeded with the 
analyses. 

b. Criterion differences between cities. Differences 
in the levels of ratings obtained for officers from diffe- 
rent cities were examined by comparing mean ratings 
obtained by all tested white male officers. The compari- 
sons were made among whites and males in order to 
avoid introducing obvious city x race and city x .sex 
interactions into the mean comparisons. Table 47 shows 
means and standard deviations on the Overall Criterion 
rating scales for each of the police functions.* Large 
diffeipences between the means for particular cities are 
shown for all functions: Minneapolis vs. Cincinnati, Des 
Moines, and Portland for patrol officers; Portland and 
San Diego vs. Minneapolis for detectives; Cincinnati and 
San Diego vs. Des Moines for sergeants; and Cincinnati, 
Washington, and Miami vs. Des Moines and Min- 
neapolis for middle command officers. Since the samples 
from each city were selected differently and since they 
were not equated for such factors as length of service, 
age, etc., the mean differences could reflect, to a degree 
at least, valid differences in job performance. At any 
rate, we had no way of knowing or estimating the degree 
to which rating errors (such as leniency) might be operat- 
ing differentially from city to city and from function to 
function. Moreover, since our job performance rating 
scales were anchored with actual incidents illustrative of 
different levels of performance effectiveness, we had 
good reason to believe that the various mean differences 
shown in Table 47 actually do reflect absolute differ- 
ences in average effectiveness for officers in these diffe- 
rent departments. Therefore, we decided to use the rating 
information as obtained instead of standardizing each 
city's information according to its own mJ!m and stan- 
dard deviation. 

c. Criterion differences by race and sex. Table 48 
shows the numbers of men, v/omen, whites, and non- 
whites contained in our samp'es according to the four 
functions. Mean ratings and standard deviations are 
shown for each of the criterion dimensions separately for 
race and sex subgroups in Tables 49, 50, 51, and 52.** 
Non-white sergeants received lower mean ratings than 



^Comparisons on only the OVERALL scales are shown for the sake 
of clarity. G)inparisons were made on all scales, but tlie general trend 
is illustrated accurately by presenting only the iz^ormation on the 
Overall scales. 

**We have not included information for the tltirtecn female patrol 
officers, the nine female sergeants, or the six non-white command 
officers in Tables 49, 51, and 52 because the samples are so small. 
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Table 46 



Means and Standard Deviations on Criterion Dimensions and T Values for Minneapolis and Portland Patrol 

Officers Who Were Tested and Not Tested 



Officers With 



Officers Rated 





N 


All Officers 
Mean 


SD 


N 


Ratings Only 
Mean 


SD 


N 


and Tested 
Mean 


SD 


t (Ratings Only 
Vs. Rated & Tested) 


Minneapolis 






















PCRIME 


237 


6.28 


1.23 


56 


6.49 


1.46 


181 


6.22 


1.15 


1.45 


P-FORCE 


237 


6.10 


1.19 


56 


6.40 


1.35 


181 


6.01 


1.13 


2.13* 


P-TEAMWORK 


237 


7.54 


.95 


56 


7.40 


1.35 


181 


7.59 


.79 


1.27 


P-OVERALL 


237 


6.94 


1.05 


56 


7.01 


1.37 


181 


6.91 


.93 


.64 


Portland 






















PCRIME 


108 


5.78 


1.46 


58 


5.62 


1.55 


50 


5.97 


1.35 


1.24 


PFORCE 


109 


5.95 


1.20 


60 


5.87 


1.11 


49 


6.05 


1.32 


.76 


P-TEAMWORK 


108 


6.31 


1.61 


60 


6.03 


1.74 


48 


6.65 


1.36 


2.02* 


COVERALL 


109 


5.87 


1.42 


60 


5.64 


1.38 


49 


6.16 


1.42 


1.93* 



*Signiftcam ai p< .06. 



^ Table 47 : . 

Means and Standard Deviations of Ratings on Overall Criterion Dimensions According to City and Police 

Functions (White Males Only) 



Patrol Officers Detectives Sergeants Middle Command 





N 


Mean 


SD 


N 


Me^ 


SD 


N 


Mean 


SD 


N 


Mean 


SD 


Cincinnati 


105 


6.10 


1.42 


43 


6.50 . 


1.20 


65 


6.94 


1.19 


24 


7.09 


1.24 


Des Moines 


95 


6.10 


1.17 








38 


5.88 


1,55 


20 


5.71 


1.14 


Miami 


58 


6.41 


1.42 








45 


6.28 


1.31 


30 


6.80 


.95 


Minneapolis 


177 


6.90 


.95 


45 


6.24 


1.33 


38 


6.63 


1.26 


28. 


5.83 


1.23 


Portland 


58 


6.15 


1.45 


46 


7.12 


.99 








18 


6.61 


1.10 


San Diego 








52 


6.94 


.86 


44 


6.84 


1.35 


30 


6.68 


1.00 


Washington, D. C. 


64 


6.32 


1.22 


46 


6.61 


1.08 


60 


6.22 


1.65 


44 


7.12 


1.00 


Combined Cities 








55* 


6.48* 


1.18*. 















•These values are for detectives from Albuquerque. Tucson, and Des Moines combined. 



Table 48 



Numbers of Men, Women, Whites and Non-WF es According to Police Function 





Patrol Officers 


Detectives 


Sergeants 


Middle Command 


Men 


747 


424 


373 


214 


Women, 


13 


26 


9 


0 


White 


640 


377 


334 


- ' 208 


Non-White 


123 


73 


'44 


6 



42 



63 



Table 49 



Patrol Officers 


Criterion Dimension 




White 






Mon- White 




N* 


Mean 


SD 


N* 


Mean 


SD 


P-CRIME 


496 


6.19 


1.28 


84 


5.60 


1.67 


P-FORCE 


50O 


6.01 


1.25 


88 


6.27 


1.25 


P-TEAMWORK 


404 


7.17 


1.25 


88 


6.40 


1.55 


P-OVERALL 


557 


6.42 


1.27 


103 


5.64 


1.63 



• are smaller than ihown in Tabic 48 becauy: rating informaiion for certain cities and certain M:ales wa* diwarded due to low itliabilities 



Table 50 



Means and Standard Deviations on Criterion Dimensions for Male. Female, White 

and Non-White Detectives 



Criterion Dimension 




White. Male 






Non-White 






Female 




N* 


Mean 


SD 


N 


Mean 


SD 


N* 


Mean 


SD 


D- INVESTIGATE 


294 


6.57 


1.53 


66 


6.23 


1.55 


24 


6.22 


1.35 


D-INTEGRITY 


164 


7.58 


1.50, 


43 


7.80 


1.31 


14 


7.79 


,90 


D-REPORTING 


212 


6.56 


1.46 


9 


6.94 


1.30 


10 


6.6d 


1.32 


D-OVERALL 


330 


6.62 


1.41 


67 


6.65 


1.04 


25 


6.44 


.81 



shoun in Table 48 bccauu: nilng inrormation for cenain cities and certain scales was discarded due to low reliabilities. 



Table 51 



Means and Standard Deviations on Criterion Dimensions for White and Non-White 

Sergeants 







White 






Non-White 




Criterion Dimension 


-N* 


Mean 


SD 


N* 


Mean* 


SD 


s-training 


314 


6.39 


1.64 


42 


5.80 


1.92 


S-SUPERVISION 


309 


6.88 


1.55 


43 


6.72 


L81 


S-INSPECTION 


238 


6.48 


1.74 


40 


6.24 


1.89 


s-overall 


3!2 


6.53 


1.42 


43 


6.00 


1.61 



than those shown in Table 48 bees t:^- rating inrormation for certain cities and certain scales was discarded doc to low reliabilities. 



Table 52 

Means and Standard Deviations on Criterion 
Dimensions for White Middle Level Command Officers 



Criterion Dimension 


N* 


Mean 


SD 


c-administration 


204 


6.62 


i.50 


C-COMMUNICATIONS 


186 


6.62 


1.55 


c-personnel 


186 


6.83 


L62 


CDEDICATION 


157 


6.79 


1.45 


COVERALL 


206 


6.64 


1.21 



•N* ire smaller than those shown in TaNe 48 because rating informMion for certain citic* 
and certain scales was diicankd due to low rdiabilitks. 



white sergeants on all performance scales. The greatest 
difference relative to the standard deviations occurred on 
the OVERALL scale, where the mean diffeicr-ce 
amounted to .35 SD, corresponding to an ovjerlap coer/i- 
cient of 86%. [See Dunnette (1966), pages 142-144, for 
an explanation of the overlap coefficient;]. Largest dif- 
ferences between the means for white aiid non- white 
patrol officers occur on the TEAMWORK and OVER- 
ALL scales, where the differences correspond 'respec- 
tively to overlap coefficients of 78 percent and 79 per- 
cent. Mean dil^ereaces between whites and non-whites 
and between and females are minor and of little 
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consequence on the criterion dimension scales for detec- 
tives. Differences shown between whites and non-whites 
for the patrol officer and sergeant ratings are discussed 
more fiilly later in this section where we discuss sub- 
group differences on the predictor scales. 

d. Height, weight, age, length of service. Criterion 
dimension comparisons were also made between persons 
above and below the midpoints on tiie variables of 
height, weight, age, and total length of police service. 
Means and standard deviations on the Overall criter- 
ion dimensions are shown in Table 53. The only mean 
differences of consequence relate to the age and length of 
service variables. As might be expected, older, more 
experienced patrol officers received higher overall rat- 
ings than younger, less experienced officers — though the 
mean difference between the two subgroups is really not 
very large (about one-third of a standard deviation). 
Interestingly, the relatively younger officers in supervis- 
ory (sergeant) and command positions received higher 



overall ratings than relatively older officers. Apparently 
many of the-**old hands" are also seen as "over the 
hill." The difference between old and young, long ex- 
perience and briefer experience is particularly pro- 
nounced among command level officers. 
2. Validities by subgroup. 

a. Cognitive tests. Correlations were computed be- 
tween scores on each of the four cognitive measures and 
all criterion dimension ratings, including the four 
pseudo-criterion RANDOM distributions. Correlations 
were computed separately for blacks and whites for the 
patrol officer, detective, and sergeant functions. The 
ranges of coefficients obtained for each function and 
median values are shown in Table 54. At first glance, 
none of the tests seem to hold much proniise. However, a 
more careful look suggests that certain of the tests may 
merit further study. For example, the verbal and sym- 
bolic reasoning tests yield potentially useful validities for 
blacks in detective jobs. This is shown in the following: 



Verbal Reasoning 
Symbolic Reasoning 



INVESTIGATE 
(N=48) 
.00 
.30 



INTEGRITY 
(N-35) 
.01 
.31 



OVERALL 
(N^49) 
.23 
.37 



The symbolic reasoning test appears especially good. 
As will be seen shortly, the predictor scales of the detec- 
tive CAREER INDEX do not appear to show good val- 
idities for blacks. Thus, the symbolic -reasoning test 
definitely merits further study. 

Black Sergeants 

TRAINING 
(N=:33) 
.24 
-.05 



Additionally, the visual speed and' verbal reasoning 
tests appear potentially useful for black sergeant and for 
middle command officers, as follows: 
Unfortunately, both tests correlate near zero with the 
overall rating for black sergeants. However, the corrcla- 



Visual Speed 
Verbal Reasoning 



SUPERVISION 
(N=:34) 
-.02 
.21 



INSPECTION 
(N=31) 
.33 
.20 



Middle Command Officers 



V'sual Speed 
Vsrbal Reasoning 



ADMIN 
(N=204) 

.11 

.16 



COMM 
(N=186) 

.15 

.22 



PERS 
(N=186) 
.11 
.17 



DEDIC 
(N=157) 
.15 
. .11 



OVERALL 
(N=34) 
,03 
-.06 



OVERALL 
(N=205) 
.22 
.22 



tions against the INSPECTION ratings show some prom- 



ise 



Also note the generally positive correlations between 
the cognitive measures and various of the predictor 
scales of the CAREER INDEX batteries. For the patrol 
officer predictor scales, highest correlations are shown 
with the verbal comprehension and verbal reasoning 
tests; of the two detective scales, DI correlates . 19 with 
verbal comprehension; neither of the sergeant scales cor- 
relates highly with any of the tests, but the visual speed 
and verbal reasoning tests show uniformly positive corre- 
lations with the command level predicto*. scales. 

b. Validity by city. Correlations between predictor 



scales and each of the criterion dimension ratings (in- 
cluding the pseudo-criterion RANDOM) were computed 
separately for officers for each of the participating cities. 
Tables showing these results are given in Appendix H. 
Results shown there are for white officers only. A later 
comparison shows validities separately for whites and for 
racial and sexual minority groups. 

The validities across cities are remarkably similar to 
the validities for the overall sample. Not only are the 
actual magnitudes of coefficients similar from city to 
city, but the patterns of higher and lower values are very 
similar over all the cities. 

For patrol officers, Miami is the only city with some- 
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Table 53 



Means and Standard Deviations on Overall Performance Ratings for Oncers Above and Below the **Midpoint*** 
on Height, V/eighi, Age, arid Length of Police Service (White Males Only) 



Height 


Pairol Officers 
N Mean SD 


N 


Detectives 
Mean SD 


N 


Sergeant 
Mean 


s 

SD 


Middle Command 
N Mean SD 


Shorter 


198 


6.46 


1.28 


116 


6.62 


.99 


83 


6.32 


1.38 


46 


6.61 


1.23 


Taller 


359 


6.39 


1.27 


213 


6.62 


1.21 


228 


6.62 


1.42 


151 


6.64 


1.19 


Weight 


























Heavier 


291 


6.45 


1.28 


195 


6.56 


1.20 


190 


6.65 


1.38 


126 


6.66 


1.20 


Slimmer 


266 


6.38 


1.27 


133 


6.72 


1.05 


120 


6.35 


1.47 


71 


6.62 


1.20 


Age 


























Older 


266 


6.56 


1.20 


156 


6.59 


1.25 


161 


6.38 


1.46 


99 


6.33 


1.26 


Younger 


283 


6.30 


1.32 


174 


6.66 


*1.03 


149 


6.68 


1.35 


98 


6.94 


1.04 


Length ofSerxhe 


























Longer 


237 


6.63 


1.04 


158 


6.52 


1.24 


156 


6.45 


1.47 


90 


6.32 


1.30 


Shorter 


307 


6.26 


1.34 


171 


6.71 


1.03 


154 


6.59 


1.37 


107 


6.90 


1.02 



•The "midpoint" wk^ cho^n lo be the caiegor> ctcnicM to ihc inetjian poinl. Splits were done separately for each function. 



what larger discrepancies from results for the total sam- 
ple than other cities show. But even Miami shows ac- 
ceptable validities for the Pill and PIV scales. 

For detectives, the DI scale shows uniform results 
across all cities, but the DII scale does not hold up well 
for officers in Cincinnati and San Diego. Recall that the 
DII scale possesses lower reliability relative to the DI 
scale. Also, the DI scale is broader in its coverage, 
longer, and was shown in bur analyses to be related to a 
wider range of performance effectiveness dimensions for 
detectives than the DII scale. 

For sergeants, results ai'c exceptionally uniform across 
all cities for both SI and SII scales and for all criterion 
dimensions. 

For middle command officers, the validities are un- 
iform across cities with the exception of scale CIII in 



Minneapolis, scale CIV in Washington, and scale CV in 
Des Moines. The most puzzling of these probably is 
scale CIII, the modal response key of the Situational 
Judgment Inventory. We can offer no explanation for its 
apparent non-validity among the 25 Minneapolis middle 
level command officers. 

Table 55 shows mean absolute deviations between 
validities in the total sample and validities in each of the 
cities for each of the predictor scales, separately for 
validities against real performance ratings and against the 
RANDOM distributions. The mean absolute deviations 
based on the RANDOM distributions can be regarded as 
rather crude empirical estimates of the amount of varia- 
tion in sizes of validity coefficients to be expected by 
strictly chance. Any mean deviation against actual per- 
formance ratings that exceeds by very much the amount 



Table 54 



Range of Values and Median Values'^ for Correlations Between Cognitive Tests and Criterion DimensiomRatings and 
Between Cognitive Tests and Predictor Scales of the Career Index 





White Officers 
Range Mdn. 


Black Officers 
Kange Mdn. 


RANDOM 
Range Mdn. 


Predictor Scales 
Range Mdn. 


Patxol Officers 
(N=513-*698) 


-05-H-09 


+01 


-24-H'+l2 


-08 


-23-*+04 


-06 


0a->433 


. +14 


Detectives 
(N=212-M15) 




+04 


-12-*+37 


+ 15 


-24-*+25 


-03 


-09-*+ 19 


+08 


Sergeants 
(N-282-*361) 


+01-fr+17 


+06 


-42-*+33 


-04 


~l3-*+06 


-04 


+04-^+15 


+ 11 


Middle Command 


-08-*+22 


+ 11 






•-10->+05 


00 


-17-*+28 


+ 11 



*Dedmab omined. 
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shown against the RANDOM scale might, therefore, be 
regarded as indicative of some systematic factors affect- 
ing d specific scalers validities in different cities. Using 
this line of reasoning leads us to conclude that predictor 
scales PIV, DI, CIII, CIV, and CV probably show 
variations in validity from city to city somewhat greater 
than might be expected purely by chance. Of these, CIII, 
CIV, and CV already have been singled out as showing 
unusually high deviations from the total sample values in 
the cities of Minneapolis, Washington, and Des Moines, 
respectively. If the information for those three cities is 
deleted for those particular scales and mean absolution 
deviations are recomputed, the values become 16, 10, 
and 14 for CIII, CIV, and CV, respectively. These 
values are very close <.o ihc values of 16, 10, and 11, 
respectively, for the CIII, CIV, and CV scales against 
the RANDOM criterion. 

Our net conclusion from these city-by-city compari- 
sons of the validities of the predictor scales is that they 
are impressively consistent. The relative stability of 
these values is especially reassuring in view of the rather 
large mean differences between various cities on ratings 
of job performance, as shown in Table 47. Those mean 
differences undoubtedly resulted in selecting items for 
predictor scales that might be at least partially con- 
founded by departmental designation or geographic loca- 
tion. Conceivably, the predictor scales could have shown 
excellent validities in the total samples but poor validities 
in most cities because of such factors as restriction in 

Table 55 

Mean Absolute Deviations* Between Total Sample Val- 





idities and 




Validities for 


Separate Cities According to Predictor 




Scale 






Against Actual 


Against Pseudo- 


Predictor 


Performance 


Criterion: Random 


Scale 


Rating Scales 


Distribution 


PI 


09 


12 


PH 


12 


13 


Pin 


10 


09 


PIV 


14 


07 


DI 


12 


06 


DII 


16 


17 


SI 


09 


13 


SII 


08 


' 17 


CI 


14 


20 


CII 


11 


15 


CIII 


20 


16 


CIV 


14 


10 


CV 


18 


11 


*DccimaU omitted. 






46 




6 



range, systematic departmental differences in the way 
officers responded to the inventories, or any number of 
other systematic but irrelevant differences from city to 
city. Fortunately, these problems did not occur. It is 
reassuring indeed to note the relative uniformity of the 
predictor scale validities across all cities. To a degree, 
these findings of reasonably consistent validities across 
cities confirm the wisdom of our eariier decision that 
criterion mean differences probably reflected actual dif- 
ferences in effectiveness from city to city instead of 
being any artifact of the way the rating scales were used. 

c. Validity by race and by sex. Correlations bet- 
ween predictor scales and each of the criterion dimension 
ratings (including the pseudo-criterion Random) were 
computed separately for officers of racial minorities 
(non-whites) and for women. Sufficient numbers of ra- 
cial minorities were available for only the functions of 
patrol officer, detective, and sergeant. A sufficient 
number of female officers were available only for the 
detective function. Results of these computations are 
shown in Tables 56, 57, and 58. Also shown in the tables 
are separate validities for whites and non-whites in 
Washington, D.C. Washington was the only city where 
sufficiently large numbers of minority personnel were 
tested to allow a direct comparison between whites and 
non-whites. 

The validities for the patrol officer predictor scales, 
shown in Table 56, are very nearly identical for. non- 
white officers and for the officers in the total sample. 
Overall scales and criterion dimensions (excluding 
RANDOM), the median validity in the total sample is 
,29. The corresponding value for non-white officers also 
is .29. Pair-by-pair comparisons between total sample 
and non- white validities show that only nine of sixteen 
differences are greater than an absolute value of .05. Of 
these, validities are five times higher for non-whites — 
four times higher than for the total sample. Direct com- 
parisons between validities for white and non-white pat- 
rol officers in Washington, D.C. yield similar conclu- 
sions. Rather large differences, occur for only the Pin 
and PIV scales; for both scales, the higher validities are 
obtained for non-whites. 

The validities for the detective predictor scales, shown 
in Table 57, are uniformly lower for minority officers 
than for officers in the total sample. The average algeb- 
raic deviation between the two sets of validities is - . 1 1 . 
The same result is apparent in the comparison of val- 
idities for white and non-white detectives in Washington, 
D.C.--especially for the DI scale, where the average 
discrepancy is a massive —.32 for the two criterion 
scales of INVESTIGATION and OVERALL. These re- 
sults, even though based on a relatively small sample of 
minority officers, suggest that the detective predictor 



Table 56 



Validities^ of Patrol Officer Predictor Scales Against All Criterion Dimensions for 
Total Sample and for Minority Officers 



Predictor Scale 



PI 

Total Sample (^'^=502) 
All Minority (N«78 - 97) 
D. C.** White (N=:60-62) 
D. C. Minority (N=72-76) 

Pll 

Total Sample (N=-452) 
All Minority (N=76-94) 
D. C. White (N=r60-62) 
D. C. Minority (N=» 70-74) 

Pill 

Total Sample (N«528) 
All Minority vN=59-71) 
D. C. White (N«55-57) 
D. C. Minority (N=*53-54) 

PIV 

Total Sample (N=372) 
All Minority (N=59-71) 
D. C. White (N=56-58) 
D. C. Minority (N=53-54). 

'Decimals omitied. 
••D. C. refers to Washingion. D. C. 



Criterion Dimension 
CRIME FORCE TEAMWORK OVERALL RANDOM 



18 


40 


13 


24 


01 


20 


36 


14 


29 


14 


20 


46 


-09 


32 


-04 


19 


40 ■ 


13 


21 


11 


29 


14 


32 


37 


03 


27 


01 


26 


38 


13 


36 


32 


28 


49 


10 


27 


05 


27 


33 


12 


41 


11 


28 


42 


04 


38 


03 


28 


48 


-01 


23 


18 


02 


28 , . 


— -07 


35 


06 


25 


50 


00 


37 


06 


54 


48 


03 


44 


19 


48 


57 


06 


03 


-19 


51 


24 


-06 


44 


24 


45 


57 


05 



Table 57 

Validities* of Detective Predictor Scales Against All Criterion 
Dimensions for Total Sample, Minority and Female Officers 



Predictor Scale 



Dl 

Total Sample (N«245) 
All Minority (N=39- 63) 
All Female (N=13-24) 
D. C:*** White (N«36-42) 
D. C: Minority (N«36) 

Dll 

Total Sampie (N«263) 
All Minority (N»30 -48) 
All Female (N== 14-22) 
D. C. White (N» 39-45) 
D. C. Minority (N-27) 



Criterion Dimension** 
INVESTIGATION INTEGFJTY OVERALL RANDOM 



52 


23 


59 


00 


33 


15 


42 


-06 


20 


35 


41 


-01 


3V 


06 


64 


12 


15 


09 


23 


-10 


li 


62 


17 


r-09 


or 


43 


21 


04 


01 


60 


16 


-33 


3« 


49 


19 


-13 


12 


45 


32 


11 



*Decinuli omitted. 

••Reiuitt ire not showti for the criteriou dimension -Reporting" h*■i^^r< swnple ^izcs were only nine for minority and scwii for females 
•••D. C. refen to W»ihin|{ton. D. C. 



Predictor Scale 



Table 58 

Validities* of Sergeant Predictor Scales Against All Criterion 
Dimensions for Total Sample and for Minority Officers 



Criterion Dimension 
TRAINING SUPERVISION INSPECHON OVERALL RANDOM 



SI 

Sample (N=27I) 
inority (N«37-40) 
White** (N«55) 
Minority (N=23-24) 

Sll 

Sample (N»286) 
[inority (N«?7-40) 

White (N«57) 

Minority (N=23 - 24) 



45 


55 


48 


59 


.00 


44 


65 


56 


61 


06 . . 


38 


50 


37 


62 


21,^ 


44 


67 


55 


61 


-02 " 


54 


37 


40 


54 


06 


55 


23 


24 


50 


-03 


58 


43 


37 


62 


30 


72 


29 


33 


57 


04 



Total 
All M 
D. C. 
D.C. 



Total 
AllM 
D. C. 
DC. 

*Dccimal» omitted. 
■*D. C. Itfen to Washinsion. D. C. 

scales may be inappropriate for use with minority candi- 
dates. Validities of the DI scale also are lower for 
females, but the validities of the DII scale show the same 
pattem of results against the criterion dimensions for 
females and for all officers in the total sample. ■ 

The validities for the sergeant predictor scales, shown 
in Table 58, are very nearly identical for non-white 
officers and for officers in the total sample. The median 
validity for the former group is .53; the corresponding 
value is .51 for the latter group. In a pair-by-pair com- 
parison of validity coefficients, t}^ average abj>olute de- 
viation is only .07. Direct coniparisoos of validities for 
white and non-white sergeants in Washington* D.C. 
yield equally impressive results. Actually, in the 
Washington samples, the validities are slightly higher for 
non-whites than for whites, showing a tttean algebraic 
difference of + .04. 

These results are extremely gratifying. Validities arc 
essentially the same for whites and for non-whites for the 
predictor scales of the patrol officer CAREER INDEX 
and the sergeant CAREER INDEX. In contrast, the 
applicability of the detective predictor scales to minority 
aril female candidates is somewhat questionable. They 
can perhaps be used but interpreted with caution until 
more information conceming their validities for minority 
and female personnel becomes available. 
3. Predictor Scale Scores by Subgroup, 
a. Unfair discrimination by race. Even though val- 
idities for tests may be the same or highly similar for 
minority and non-minority persons (as has been shown 
for the patrol officer and sergeant predictor scales), use 
of those tests for employment or promotion decisions 
could still lead to charges of unfair discrimination on the 
basis of race. This could be the case if minority person- 
nel systematically score lower than non-minority person- 



nel on the tests. Under those conditions, a higher propor- 
tion of non-minority candidates than of minority candi- 
dates would be accepted for position openings. Such 
disparity of selection proportions may not, in and of 
itself, be evidence of unfair discrimination if the tests arc 
indeed equally valid for both minority and non-minority 
candidates, and it is possible to show that the lower 
scores obtained by minority candidates arc, in fact, mir- 
rored by similarly lower levels of job performance for 
minority persons. In contrast, if lower test scores for 
minorities arc not mirrored by lower job performance 
ratings, a charge of unfair discrimination on the basis of 
test information is. likely to be quite viable. In essence, 
then, a test developer needs to: (1) evaluate the relative 
levels of job performance for minority and non-minority 
persons; (2) compute test validities separately for minor- 
ity and non-minority persons; and (3) evaluate the rela- 
tive levels of test performance for minority and non- 
minority persons. If the validities of tests arc shown to be 
the same for both groups, use of the test for selection or 
promotion decisions can be regarded as fair if the relative 
levels of test performance for minority and non-minority 
persons is equivalent to the relative levels of job perfor- 
mance shown by the two subgroups. Then we can legiti- 
mately state that persons, regardless of subgroup mem- 
bership, with equal probabilities of showing particular 
levels of job performance effectiveness, will also have 
equal likelihoods of being "accepted" by the test renults. 

We have ahcady shown that the validities of CAREER 
INDEX predictor scales for patrol officer and sergeant 
functions are very similar for minority and non-minority 
persons. Recall also that we showed (Tables 49, SO, and 
51) that minority patrol officers and minority sergeants 
received lower mean performance effectiveness ratings 
than their non-minority counterparts in these two func- 
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Table 59 



Means* and Standard Deviations on Patrol Officer Career Index Predictor Scales According to Race of Examinee 







Non-Minorily Officers 






Minority Officers 




Mean Difference 


Predictor Scale 


N 


Mean 


SD 


N 


Mean 


SD 


SD Ave. 


PI 


. 500 


-3.73 


8.04 


97 


-5.01 


6.83 


0.17 


PII 


493 


-25.37 


19.53 


94 


-42.63 


22.03 


0.83 


Plil 


476 


-6.74 


7.48 


71 


-11.99 


7.90 


0.68 


PIV 


464 


-7.37 


10.71 


71 


-26.92 


12.47 


i.68 



'Scores aiv in tcm% of raw «cofrt based directly on the weights asvigned to item responds. 



Table 60 



Means* and Standard Deviations on Detective Career Index Predictor Scales According to Race of Examinee 







Non-Minority Officers 






Minority Officers 




Mean Difference 


Predictor Scale 


N 


Mean 


SD 


N 


Mean 


SD 


SD Ave. 


DI 


312 


.32 


16.60 


63 


-5.22 


14.05 


0.54 


DII 


275 


-1.75 


6.08 


48 


«81 


6.16 


0.42 



"Scores are in lerni^ of raw Mrores based di-rclly on the weights assigned to item responses. 



Table 61 

Means* and Standard Deviations on Sergeant Career Index Predictor Scales According to Race of Examinee 



Non-Minority Officers Minority Officers Mean Difference 
Predictor Scale N Mean SD N Mean SD SD Ave. 

SI 302 3.33 7.92 40 . 1.67 8.95 0.20 
SII 301 -1.54 6.13 40 -4.03 6.66 . 0.39 

*&ores are in iem» of raw mtotcs based direcUy on the weights assigned to item responses. 



tions. In contrast, minority detectives received mean 
performance ratings almost identical to the mean ratings 
received by non-minority detectives. It is time, then, for 
us to examine the predictor scale score distributions 
separately for minority ar^ non-minority persons to see 
how closely they may mirror the distributions of rated 
job performance shown in Tables 49, 50, and 51. 

b. Predictor scale mean differences by race. Means 
and standard deviations of predictor scale scores are 
shown separately for minority and non-minority officers 
in Tables 59, 60, and 61. 

Results for patrol officers, shown in Table 59, show 
that mean differences are uniformly in favor of non- 
minority officers, ranging from an extremely small dif- 
ference on PI to a whopping difference (overlap equal to 
only 40%) on PIV. In contrast, the mean difference on 
the OVERALL criterion dimension performance rating 
was only about one-half of a standard deviation 
Mean Difference ^ 54 j^ius, for purposes of re- 
SD ave 

porting patrol officer CAREER INDEX predictor scale 
scores, adjustments have been made to assure overall 
score distributions for minority and non-minority candi- 



dates with mean differences equivalent to that shown by 
the overall job performance rating. 

Results for detectives, shown in Table 60, show that 
mean differences arc again in favor of non-minority 
officers. Both scales show mean differences of about 
one-half a standard deviation. In contrast, the mean dif- 
ference on the OVERALL criterion dimension perform- 
ance rating was negligible Mean Difference = o2 . 

SD ave , 

Thus, for purposes of reporting detective CAREER 
INDEX predictor scale scores, adjustments have been 
made to assure overall score distributions for minority 
and non-minority candidates with no mean differences. 

Results for sergeants, shown in Table 61, show small 
mean differences, again in favor of non-minority offic- 
ers. The differences on the two predictor scales are of the 
same order of magnitude as the mean differences (shown 
in Table 51) between non-minority and minority persons 
on the fcur criterion dimension rating scales for 
sergeants. 

[Values of Mean Difference for the sergeant ratings 
SD ave 
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ranged from 0.10 and 0.13 on SUPERVISION and IN- 
SPECTION to 0.33 and 0.35 on TRAINING and 
OVERALL.] Thus, the distributions of predictor scale 
scores already mirror quite well the distributions of job 
performance ratings for minority and non-minority per- 
sons, and no adjustments need to be made to the score 
disuibutions for minority candidates /or sergeant level 
positions. 

I. Standard Scoring and Interpretive Infor- 
mation for POUCE CAREER INDEX 

I . Patrol Officer CAREER INDEX, 
d. Interpretation of scores. Four predictor scales 
are now available for estimating a candidate's potential 
job performance as a patrol officer. Our research has 
shown that each of the four scales is moderately related 
to ratings of overall job effectiveness for patrol officers. 
Yet each of the four also is somewhat more highly 
related tc one of the criterion dimensions than to the 
others. For example, scale PI correlates most highly with 
performance ratings involving settling disputes between 
Cktizcns, using force appropriately, dealing construc- 
tively with the public, and keeping cool under pressure. 
Scale PII is less highly correlated with such performance 
areas as those just mentioned but does show higher 
relationships with all other facets of a patrol officer's job 
performance. Scale PHI correlates most highly with per- 
formance ratings involving crime prevention, detection 
and investigation, maintaining public safety, and con- 
scientiousness and dedication. Finally, scale PIV corre- 
lates most highly with performance ratings involving 
teamwork and cooperation with other officers, with other 
divisions and departments, and other law enforcement 
agencies. 

Additional detailed examination of the behavioral 
coyjiponents of the performance ratings most highly re- 
lated to each of the patrol officer predictor scales, PI, 
PII, PHI. and PIV. yields titles and brief descriptions of 
what each scale is measuring as shown below: 

PI [Public Contact] measures Personal Attitudes 
and Opinions* related to effectiveness in those 
aspects of a patrol officer's job involving deal- 
ing constructively with the public, using tact, 
courtesy, and understanding, keeping ''cool" 
under pressure, maintaining composure, 
mediating disputes between persons effec- 



*The italics in these interpretive descriptions refers to the kinds of 
items making up each scale. * 'Personal Attitudes and Opinions" refers 
ta personality inventory type items. **Per$onal Preferences and Inter- 
ests" refen (o interest inventory type items. ''Personal Background 
and Experience" refers to personal background inventory type items. 
**Job Judgment" (in scales for sergeants and middle command) refers 
to situatranal judgment inventory type itemi. 



tively, and developing a good police ''image" 
in the eyes of the public. 

PII [Overall] measures Personal Attitudes and 
Opinions related to overall effectiveness as a 
patrol officer as shown especially in such areas 
as team work, investigating crime, ethical 
conduct, accurate reporting, and maintaining a 
cool and even manner in handling all aspects 
of the job of patrol officer. 

Pin [Crime Prevention] measures Personal Pre- 
ferences and Interests related to overall effec- 
tiveness as a patrol officer. Effectiveness in- 
cludes overall value to the department as 
shown especially in effectiveness in prevent- 
ing criminal activity, being alert to suspicious 
situations, detecting anci investigating crimi- 
nal activity, maintaining public safety, arKl 
overall conscientiousness and dedication in 
carrying out the job of patrol officer. - 

PIV [COoperdiion] rnQSisuTts Preferences and Per- 
sonal Background and Experience itlaied to 
overall effectiveness as a patrol officer; Effec- 
tiveness includes overall personal contribution 
to departmental effectiveness as shown espe* 
cially in effective cooperation with other 
officers, other divisions or departments, and 
law enforcement agencies in effectively pre- 
venting crime and following up on criminal 
activities. 

b. Standard report form for patrol officer candi- 
dates. Even though we have outlined above how each of 
the patrol officer predictor scales may be ititeipreted 
according to somewhat different facets of job perform- 
ance, we shoiilci hot lose sight ofthe very^gfrlidnTBLai 
tions which were obtained between ratings on all criter- 
ion dirhensions nor of the moderately high correlations 
between scores on each predictor scale and ratings of 
overall performance effectiveness. Because of these high 
interrelationships, we decided to provide an estimate of 
TOTAL POTENTIAL as a patrol officer by combining a 
""candidate's scores on the separate scales PI, PII, PHI, 
and PIV. We decided to weight the scales PII and PIV 
somewhat more heavily than the scales PI and PHI, 
because the former two scales have higher reliabilities 
and higher estimated cross-validities than the latter two 
scales. Thus, the following combining weights were 
chosen for deriving the TOTAL POTENTIAL estimate 
for the patrol officer CAREER INDEX: TOTAL PO- 
TENTIAL = PH- 1.5 PH + Pin + 1.5 PIV. 

Finally, recall that the separate estimates of the ex- 
pected validities for the four patrol officer predictor 
scales are PI: .19; PU: .26; PHL .23; and PIV: .28. If we 
now assume that each scale is correlated with a construct 
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called "Overall Patrol Officer Job Performance" at least 
as well as these estimates, we can use them in combina- 
tion with knowledge of the correlation matrix between all 
pairs of predictor scales to derive an estimate of the 
expected validity of the TOTAL POTENTIAL compo- 
site. The value we have estimated by this means is ,32* 

A preliminary format for reporting scores in easily 
interpreted form for the patrol officer CAREER INDEX 
is shown as Figure 3. 

Note that the report format provides results separately 
for each predictor scale and . for the weighted TOTAL 
POTENTIAL composite of the four scales. The scoring 
system also provides capability for ranking the candi- 
dates tested by any given department and reporting each 
candidate's relative standing within that group. The 
norms used for designating the letter grade and below 
average categories are based on the officers who took 
part in our studies. The category designations are equiva- 
lent to the following percentages of officers: 

A : Top 7% 

B+ : Next 9% Top 50% of officers 

B : Next 7% in national norm group 

B- : Next 8% 

C+ : Next 19% 



*Stathttcians may well rebel in horror against this crude approach 
for estimating the validity of the TOTAL POTENTIAL composite, 
based as it is on cross-validity estimates with incompletely known 
statistical properties, an assumption of a hypothetical ''Overall Job 
Performance** construct, and rather unstable estimates of the matrix of 
correlations between predictors. We obviously cannot say much about 
the above estimated value. It provides^ at this stage, merely a crude 
**feer' for what we may hope for in using the combined predictors. 
New studies need to be done to pin down with more certainty what the 
validity of the TOTAL POTENTIAL composite may be in actual use. 
The same is true, of course, for the estimates made for the detective, 
sergeant and middle command composites. 



BELOW AVERAGE: Bottom 50% of officers in na- 
tional norm group 

2. Detective CAREER INDEX, 

a. Interpretation of scores. Two predictor scales 
are now available for estimating a candidate's potential 
job performance as a detective. Our research has shown 
that scores on DI are much more broadly related to 
effectiveness as a detective than scores on DII. Also, DI 
scores are highly correlated with ratings of overall job 
effectiveness for detectives, whereas DII scores correlate 
rather low with such ratings. 

Descriptions of Measures 

PI [Public Contact] measures Personal Attitudes 
and Opinions related to those aspects of a 
patrol officer's job involving dealing construc- 
tively with the public, using tact, courtesy and 
understanding, keeping ''cool** under pres- 
sure, maintaining composure, mediating dis- 
putes between persons. 

PII [Overall] measure Personal Attitudes and 
Opinions related to overall effectiveness as a 
patrol officer as shown especially in team- 
work, investigating crime, ethical conduct, 
accurate reporting, and maintaining a cool and 
even manner. 

PHI [Crime Prevention] measures Personal Pre- 
ferences and Interests related to preventing 
criminal activity, being alert to suspicious 
situations, detecting and investigating crimi- 
nal activity, maintaining public safety, and 
level of conscientiousness and dedication in 
carrying out the job. 

PIV [Cooperation] measures Preferences and Per- 
sonal Background and Experience related to 
effective cooperation with other officers, other 



Figure 3. Sample report format for results from the Patrol Officer POUCE CAREER INDEX. 

Pa'^ol Officer 

Name of Candidate: 

Estimated Potential Effectiveness as Patrol Officer 



BELO W A VERAGE C-l- B- B B-l- A 

PI Public 

Contact 
PU Overall 
PHI Crime 

Prevention 
PIV Cooperation 

TOTAL POTENTIAL 

This Patrol Officer candidate ranks JL out of 163 candidates tested in your depart- 
ments. 
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divisionVbr departments, and law enforce- 
ment agencies. 
Detailed examination of the behavioral components of, 
the performance ratings most highly related to each of 
the two detective predictor scales yields titles and brief 
descriptions of what each scale is measuring as shown 
below: 

DI [Overall] measures Personal Background and 
Experience related to overall effectiveness; as 
an investigating officer (detective) EffexVjve- 
ness includes gathering and coouVDiarng 
important information at the scene of u crime; 
following lip'^tKrougKly in investigating and 
prosecuting a case^; interrogating suspects 
completely and with an open mind; knowing 
and using proper procedures in search, sei- 
zure, and arrest; protecting physical evidence; 
keeping complete records; reporting all infor- 
mation concisely and accurately; and exerting 
maximum effort at all times both oh and off 
duty. 

DII [Personal Integrity] measures Attitudes and 
Personal Background and Experience related 
to effectiveness in those aspects of an inves- 
■■^r.- tigating officer's job involving fairness and 
integrity in dealing with all cases equally, av- 
oiding personal prejudices arid bias, working 
effectively with juveniles, resisting oppor- 
tunities to use one's badge for personal gain. 
b. Standard report form for detective candidates. 
Again we should not lose sight of the high correlations 
which were obtained between ratings on all the criterion 
dimensions of detectives' job performance. Thus, even 
though DI and DII do provide information about some- 
what separate facets of a detective candidate's expected 
job performance, the two scales may still be combined to 
form an estimate of TOTAL POTENTIAL as a detective. 



In combining DI and DII, we took account of the consid- 
erably higher reliability and highe- estimated cross- 
validity shown by DI as compared with DII. Thus, the 
following combining weights were chosen for deriving 
the TOTAL POTENTIAL estimate for the detective 
CAREER INDEX: TOTAL POTENTIAL = 2DI + DII. 

Again, recall that separate estimates were made of the 
expected validities for the two detective predictor scales. 
They are DI: .30; and DII: .21. These estimates were 
used to compute a crude estimate of the expected validity 
of the TOTAL POTENTL\L composite. The value we 
estimated is .36. 

A preliminary format for reporting scores in easily 
interpreted form for the detective CAREER,INDEX is 
shown as Figure 4. 



Descriptions of Measures 

DI [Overall] measures Personal Background and 
Expierience related to overall effectiveness in 
gathering and coordinating all impbrtiuit in- 
formation at the scene of a crime, following 
up thoroughly in investigating and prosecuting 
a case, interrogating suspects completely and 
with an open mind, knowing and using proper 
procedures in search, seizure, and arrest, pro- 
tecting physical evidence, keeping complete 
records, reporting all information concisely 
and accurately, and exerting maximum effort 
at all times both on and off duty. 
DII [Personal Integrity] measures Attitudes and 
Personal Background Experience related to 
fairness and integrity in dealing with all cases 
equally, avoiding personal prejudices and 
bias, working effectively with juveriiles, and 
resisting opportunities to use one's badge for 
personal gain. 



Figure 4. Sample report format for results from the Detective POLICE CAREER INDEX. ♦ « 

Investigating Officer (Detective) 

Name of Candidate: . 

Estimated Potential Effectiveness as Investigating Officer 



BELOW AVERAGE C+ 



B- B B+ A 



DI Overall 
DII Personal 
Integrity 
TOTAL POTENTIAL 
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This Detective candidate ranks 1 out of 64 candidates tested in your depart- 
ment. 
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3. Sergeant CAREER INDEX 

a. Interpretation of scores. Two predictor scales 
are now available for estimating a candidate's potential 
job performance as a sergeant. Our research has shown 
that scores on SI and Sn are very nearly equally and 
highly correlated with ratings of overall job effectiveness 
for sergeants. However, each is also correlated most 
highly with slightly different facets of job performance in 
the job of police sergeant. SI involves a somewhat 
greater emphasis on planning, coordination, and decision 
making. SII involves a somewhat greater emphasis on 
dealing effectively, in a human relations sense, with 
subordinate? officers. 

Detailed examination of the behavioral coniponents of 
the performance ratings most highly related to each of 
the two sergeant predictor scales yields titles and brief 
descriptions of what each scale is measuring as shown in 
the following: 

SI [Supervisory Coordination] measures Job 
Judgment related to overall effectiveness of 
officers with sergeant rank. Effectiveness in- 
i ' eludes observing, evaluating, and correcting 

subordinates, inspecting officers and vehicles, 
scheduling duty time efficiently and fairly, 
deploying officers and vehicles to take account 
of crime trends, and taking initiative and 
showing leadership in unusual situations 
where firm guidelines do not exist. 
[Supervisory Consideration] measures Per- 
sonal Background and Experience related to 
overall effectiveness of officers with sergeant 
rank. Effectiveness includes showing personal 
interest and awareness of subordinates' needs, 
recognizing and praising good performance, 
training and orienting subordinates for overall 
improvement of performance, using courtesy 



SII 



sons, and showing a constructive attitude at all 
times. 

b. Standard report form for sergeant candidates. In 
the case of these scales^ it is especially important that we 
remember that though they measure different facets of a 
sergeant's job performance, they are both basically cor- 
related with overall job performance effectiveness. Thus, 
they may be combined to form an estimate of TOTAL 
POTENTIAL as a sergeant. In combining SI and SII, no 
basis exists for weighting them differentially. [They are 
of essentially equal reliability and validity.] Thus, 
TOTAL POTENTL\L = SH- SU. 

The separate estimates made of the expected validities 
for the two sergeant predictor scales are SI: . 19; and SII: 
.22. Computing a crude estimate of the expected validity 
of the TOTAL POTENTIAL composite yields a value of 
.25. 

A preliminary format for reporting scores in easily 
interpreted form for the sergeant CAREER INDEX is 
shown jn Figure 5. 

4. Middle Level Command Officer CAREER INDEX, 
a. Interpretation of scores. Five predictor scales 
are now available for estimating a candidate's job per- 
formance a middle level command officer. Our re- 
search has shown that each of the five scales is quite 
highly related to ratings of overall job effectiveness for 
middle level command personnel. Yet, detailed examina-' 
tion of the behavioral components of the performance 
ratings most highly related to each of the conmiand level 
predictor scales, CI, CII, CII!, CIV, and CV, yields 
titles and brief descriptions of what each scale is measur- 
ing as in the following: 

CI [Administration] mtasurts Personal Attitudes, 
Opinions, Background, and Experience re- 
lated to effectiveness in those aspects of t 
middle command officer's jq^ involving ad- 



and understanding in working with other per- 
FiGURE 5. Sample report format for results from the Sergeant POLICE CAREER INDEX 

Sergeant 



Name of Candidate: 



Estimated Potential Effectiveness in Rank of Sergeant 



BELOW AVERAGE C+ 



B- B B+ A 



SI Supervisory 
Coordination 
SII Supervisory 
Consideration 
TOTAL POHTENTIAL 



This candidate for promotion to rank of Sergeant ranks ^ out or 23 c andidates tested 
in your department. ■* 
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ministrative and scheduling duties, assigning 
manpower, preparing and reviewing reports, 
keeping up-to-date records, supervising 
equipment and station maintenance, and or- 
ganizing ofnce procedures. 

CII [Overall I] measures Personal Background 
and Experience related to overall effectiveness 
in all aspects of a middle command officer's 
job. Effectiveness includes total overall con- 
tnbution to departmental effectiveness 
through developing, training, and motivating 
subordinates; handling administrative and 
scheduling duties; accepting responsibility 
tlirough dedication and commitment; dealing 
courteously with the public; and taking effec- 
tive command in field situations. 

cm [Overall 2] measures Job Judgment related to 
overall effectiveness in all aspects of a middle 
command officer's job. Effectiveness includes 
total overall contribution to departmental ef- 
fectiveness through developing, training, and 
motivating subordinates; handling administra- 
tive and scheduling duties; setting a good 
example for subordinates; dealing courteously 
with the public; and taking effective command 
in field situations. 

CIV [Dedication] measures Background and Ex- 
perience related to effectiveness in those as- 
pects of a middle command officer's job in- 
volving dedication, integrity, and setting a 
good example for subordinates; accepting re- 
sponsibility; resisting opportunities for using 
one's position for personal gain; and project- 
ing a picture of stature and competence as a 
police officer. 

Descriptions of Measures 

SI [Supervisory Coordination] measures Job 
Judgment related to observing, evaluating, and 
correcting subordinates; inspecting of Iick rs 
and vehicles; scheduling duty time efficic/.hi)i 
and fairly; deploying officers and vehicles to 
take account of crime trends; and taking ini v'a* 
tive and showing leadership in unusual imj^- 
tions where firm guidelines do'not exist. 

Sn [Supervisory Consideration] measures/'fr^of^^v' 
Background and Experience related to showmo, 
personal interest and awareness of subordi- 
nates' needs, recognizing and praising good 
performance, training and oiienting subordi- 
nates for overall improvement oi performance, 
U6ing courtesy and understanding ir4 working 
wiih other persons, and showing a constructive 
attitude at all times. 



CV [Personnel] measures Job Judgment, Personal 
Background, and Experience related to effec- 
tiveness in those aspects of a middle conunand 
officer's job involving evaluating subordi- 
nates; giving them feedback on their perform- 
ance through discussions, commendations, 
and disciplinary actions; planning and imple- 
menting training as required; and giving sub- 
ordinates broad opportunities for develop- 
ment. 

b. Standard report form for middle level command 
officer candidates. Here, too, though the predictor scales 
may be used to evaluate slightly different facets of a 
candidate's potential for serving as a command officer, the 
performance ratings against which the scales were vali- 
dated were highly correlated, and scores on each scale are 
highly correlated with overall effectiveness estimates, 
llius, the separate scales were combined to form a 
TOTAL POTENTIAL estimate for middle level command 
candidates just as wa^ done for the patrol officer, detec- 
tive, and sergeant scales. We decided to weight scales CHI 
and CIV somewhat more heavily than scales CI, CII, and 
CV. Our reasoning for this was based on the relatively 
high validities shown by jpm arid CIV and on the very 
high correlations shown between all pairs of scales CI, 
CII, and CV. These high correlations already assured that 
they would be weighted heavily; greater weights were 
needed for Cni and QV in order to give them a reasona- 
bly "equal footing" in effecting variation in the TOTAL 
POTENTIAL composite. Thus, the following combining 
weights were chosen for deriving the TOTAL POTEN- 
TIAL estimate for the middle level command officer 
CAREER LMDEX: TOTAL POTENTLfl^L = Q + CU + 
1.5 era + 1.5 CIV +CV. 

The separate estimates of the expected validities for the 
JvvT^> ^niddls level command officer predictor scales arc CI: 
.74'. 34; CI;S: .32; CIV: .30; and CV: .25. Again, 
^ii*':U;inng that each scale is correlated with a construct 
ca)ift; 'Overall Middle Command Officer Job Perfor- 
anaticiV at least as well as the above estimates, we can 
^^nxjtV'd to estimate ap expected v.'Uidity for the TOTAL. 
POIiciMTIAL composKte. The value we have estimated by 
this iTii shod is .39. 

A. preliminary format for reporting scores in easily 

>;ipreted form for the middle level conmiand officer 
CAREER INDEX is shown in Rgurc 6. 

5. Operational use ofPOUCE CAREER INDEX. The 
POLICn CAREER If^DEX consists of three inventories. 
The first inventory, utivd Bio^;<ph!cal and Petsc:i&; In- 
formation, contains 393 i».cms. Vhh inventory coiilains 
all items necessary for scoring predictor scales PI, PII, 
Pin, PIV, DI,7>n, SII, CI, CII, CIV, and part of CV. 
The second in ventory, titled Situational Judgment Inven- 
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Figure 6. Sample report format for results from the Middle Level Command Officer POLICE CAREER INDEX, 

Middle Level Comniand Officer 

Name of Candidate: . 

Bstimated Potential Effectiveness in Middle Level Command Position 



BELOW A VER AGE 



C+ 



B- 



B+ 



CI Administration 
CII Overall 1 
cm Overall 2 
CIV Dedication 
CV Personnel 
TOTAL POTENTIAL 



This candidate for MiddSe 
your department. 

tory: Sergeants, contains the 82 situational judgmeur 
items for scoring predictor scale SI. The third inventory -, 
titled Situational Judgment Inventory: Intermediate: 
Commanders contains the 75 situational judgment itenvi- 
for scoring predictor scale CI II and the situational }ndg- 
ment part of predictor scale CV. The inventories can he 
administered quickly and easily by a competent clerical 
person to groups of candidates numbering as Idi^e a:> 
75 to 100. The time required for administration is rjj 
more than two hours [the average time for a canc^idii.c is 
about 75 minutes] for the Biographical and Fer:«onal 
Information Inventory and about 45 minutes for either 
one of the Situational Judgment Inventories. Candicl^Utits' 
completed inventory booklets may then be mailed lo a 
central scoring location where responses are 
keypunched, automatically scored, and interpretive pro- 
files t&ee Figures 3, 4, 5, 6] printed by computer aiid 
returned to the site of testing. Turnaround time between 
date of testing and date of receiving completed icsults 
typically should be about three to four days at jaicst. 

Descriptions of Measures 

CI [Administration] measures P^r^oi?^;^ ,'ittitudes, 
Opirtrons, Background, and Experience re- 
lated to effectiveness in adminisiaative and 
scheduling duties, assigning manpower, pre- 
pn/ing and reviewing reports, keeping up-to- 
dale records, ^nd supervising t^quipment and 
station maintenance. 

CD [Overall 1] measures Per^arvxi Background 
and Experience related to overall effectiveness 
in developing, training, and motivaring subor- 
dinates, handling administrative ^svl schedul- 
ing duties, accepUng resppnsibilirv, dealing 
courteously with the public, and taking effec- 
tive command in field situations. 



Lijvel Command ranks _6_ out of 42 c andidates tested in 

cm [Overall 2] measures Job Judgment related to 
overall effectiveness in developing, training, 
and motivating subordinates, handling ad- 
ministrative and scheduling duties, setting a 
good example for subordinates, dealing 
coujieo'isly with the public, and taking effec- 
tive ccinmand in field situations. 

CIV [Dedication] measures Background and Ex- 
perience related to dedication, integrity, ac- 
cepting responsibility, and resisting oppor- 
tunities for using one's position for personal 
gain. 

CV [?QrsonnQl]mt?isuTtsJob Judgment, Personal 
Background, and Experience related to effec- 
tiveness in evaluating subordinates, giving 
them feedback on their performance through 
discussions, commendations, and disciplinary 
actions, and planning and implementing train- 
ing as required. 

At present, we can recommend use of the CAREER 
INDEX testing and scoring systems for all candidates for 
patrol officer^ sergeant, and middle conmiand officer 
positions. Since the validities of predictor scales of the 
detective CAREER INDEX were considerably lower for 
minority persons than for whites, we recommend that it 
be used for selection decisions for only non-minority 
persons at present. Its administration to minority, candi- 
dates for research purposes is recommended, however, 
in order to develop additional information about its 
applicability for operational use with such' candidates. In 
the meantime, local departments may also wish to make 
research use of the EAS symbolic reasoning tests, which 
showed validities in the .30s against ratings of perfor- 
mance ieffectiveness for black detectives.: 

The booklets comprising the three POLICE CAREER 
INDEX Inventories are included in Appendix I. 
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CHAPTER III. DEVELOPMENT OF POLICE ASSESSMENT CENTER 

EXERCISES 



Besides the POLICE CAREER INDEX discussed in 
earlier chapters, a second tiiajor thrust in our effort to 
devise valid police seiectiot; and promotion tools is the 
development of exerc/s^^ for use in police assessment 
centers. Most of thesv <;;\crcises were designed to simu- 
late important aspc^*}> c^t*p^^'^^^ work. They represent as 
closely as possible, withv^ th'^ constraints of a standar- 
dized testing situation, act^ial job activities performed by 
police officers in the four functions under study; namely, 
patrol officers, detectives, sergeants, and intermediate 
commanders (lieutenants and captains). These exercises 
include role-play situations in which a candidate, in the 
role of a police officer, must deal individually with an 
assessor in the role of a citizen or that of another police 
officer. They also include group exercises in which can- 
didates participate in discussions designed to elicit either 
cooperative or competitive behavior among candidates. 
And they include administrative paperwork simulations 
requiring candidates^ to process information and perform 
administrative functions similar to those performed by 
patrol officers, detectives, sergeants, and intermediate 
commanders. There are other miscellaneous simulation 
exercises as well. Because they simulate actual police 
jobs, these exercises afford candidates the opportunity to 
demonstrate how well they can perform activities re- 
quked for effectiveness in police work. 

A. History of tlit;^^ Use of Assessment Centers 

* ^ Simulation exercises have been the backbone of sev- 
eral testing programs since World War II when German 
and British military psychologists developed and used 
simulations to help select military officers. In the United 
States, the Office of Strategic Services (OSS) used simi- 
lar procedures for selecting intelligence operatives. Can- 
didates taking part in the OSS testing program partici- 
pated in a wide range of paper-and-pehcil tests, inter- 
views, and simulations over a period of several days. 
The simulations were intended to reflect aspects of field 
intelligence work under wartime conditions and some 
were therefore designed to be highly stressful. 

Bray and his associates used a similar assessment 
program as part of their long-range study of managerial 
talent* at AT&T (Bray, Campbell, and Grant, 1974). 
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Beginning in 1956, they assessed a large number of new 
managers at AT&T through the use of multiple testing 
procedures including interviews, paper-and-pencil tests, 
and simulations. The simulations, of course, were meant 
to represent aspects of the manager's job and iiK:luded 
such exercises as a business game, a group discussion, 
and an in-basket containing the type of written adminis- 
trative materials which managers must typically p^ess: 
Testing programs like those described previously 
came to be called ''assessment centers." They are 
characterized by the use of multiple testing techniques; 
multiple observers evaluating candidates' performance in 
the various tests; and, what is perhaps the major iiuiova- 
tion of these assessment programs, the use of exercises 
simulating important activities of the job and eliciting 
behavior presumed to be closely similar to behavior on ■ 
the job itself. 

Since the landmark study initiated by Bray and his 
associates at AT&T, assessment centers for managerial 
candidates have been developed in several American 
organizations, including Standard Oil Co. of Ohio; In- 
ternational Business Machines Corp.; General Electric. 
Co.; Sears, Roebuck & Co.; J. C. Penney Co.; and the 
Internal Revenue Service. Dunnette (1971) has reviewed 
in detail issues surrounding the development, use, and 
validity of these managerial assessment centers. Re- 
cently, the use of simulation exercises in the context of 
an assessment center has been extended to the area of 
police selection and promotion. Police assessment cen- 
ters have been developed for the New York City Police 
Department and by the International Association of 
Chiefs of Police as part of their Professional Police 
Registry and Assessment Service. 

The NYCPD Assessment Center was designed to as- 
sess the . potential of high level commanders in the 
NYCPD for effectiveness in police management (D'Arcy 
and Piccolino, 1973). Consultants (associated with 
Rohrer, Hibler, and Replogle Institute, Inc.) who 
worked with the NYCPD to develop this assessment 
center interviewed a number of police captains to deter- 
mine the nature of their job activities and their relation to 
the rest of the police organization. Based on their study 
of the captain's role in the NYCPD, the consultants 



established a list of dimensions for evaluating an indi- 
vidual's potential for effectiveness as a police manager. 
Twenty-seven dimensions, distributed among five major 
categories, were defined. These five categories and soiife 
representative dimensions appear below (from D*Arcy 
and Piccolino, 1973, pp. 31-33): 

1. Problem-solving dimensions, 

• Problem analysis. Grasps the source, nature, and 
key dimensions of a problem. 

• Judgment. Recognizes intuitively or otherwise 
significant factors and comes to a sound, practi- 
cal decision. 

2. Communication dimensions. 

• Dialogue skills. Effectiveness of discussion and 
expression in person-to-person or small group 
interactions. 

• Writing skills. Expresses ideas in writing with 
facility. 

3. Emotional and motivational dimensions. 

• Reaction to pressure. Functions in a controlled, 
effective manner under stress, keeps his head. 

• Drive. Amount of directed, sustained energy 
brought to bear in accomplishing objectives. 

4. Interpersonal dimensions. 

• Insight into others. Ability to proceed giving due 
consideration to the needs and feelings of others. 

• Leadership. Directs the behavior of others to- 
ward the achievement of common goals by his 
charisma, his insights or the assertion of his will. 

5. Administrative dimensions. 

• Planning. Forward thinking, anticipates situa- 
tions and problems and prepares in advance to 
cope with them. 

• Commitment to excellence. Determination that 
task will be doiie well, achieves high standards. 

Next, the consultants prepared a set of simulation 
exercises, background interview, and paper-and*pencil 
tests to tap the 27 dimensions of police management 
effectiveness. The simulations include the following: 

• In-basket exercise. Candidates assume the role of a 
newly appointed precinct commander and work 
through a packet of memos, letters, and other ad- 
ministrative materials such as would be found in a 
police commander's in-basket. 

• Television special exercise. A group of four to six 
candidates with specially assigned roles engage in a 
leaderless group discussion to develop a television 
documentary about police work. 

• Mrs. Hairs accident exercise. Each' candidate con- 
ducts an interview to learn as much as he can about 
the fictional case of Mrs. Hall who had an ''acci- 
dent." 



# Management cases exercise. A group of six candi- 
dates participate in a leaderless group discussion to 
try to resolve five major problems relevant to the 
NYCPD. 

• Manpower planning exercise. Candidates first work 
individually to prepare solutions to a problem in- 
volving manpower planning in a police organiza- 
tion. They subsequently present their solutions ver- 
bally to the others and then discuss the problem as a 
group to develop solutions and recommendations. 

The five simulation exercises constitute the bulk of the 
Police Assessment Center for Commanders conducted by 
the NYCPD. In the 2V^-day testing session, they provide 
a nkajbr portion of the total assessment information about 
the likelihood that a candidate will be effective in the 27 
dimensions of police management effectiveness. 

Researchers associated with the International Associa- 
tion of Clhiefs of Police utilized somewhat similar proce- 
dures in developing their Police Assessment Center 
(Kent, Wall & Bailey, 1974). First, they specified be- 
havioral components and conducted task analyses for the 
fpllowing categories of police positions: police officer, 
police commander, and police executive. Then, meeting 
with active law enforcement professionals, they prepared 
lists of assessment dimensions like ''judgment,'* "deci- 
sion making," ^nd "problem analysis." And finally, to 
tap these assessment dimensions, lACP researchers de- 
veloped several types of simulations, including group 
discussion exercises and in-baskets. 

Fhe general strategy for developing assessment center 
simulations, as illustrated by the NYCPD and lACP 
procedures described briefly above, include!^ three main 
steps: (a) analyzing the position which the exercises are 
intended to simulate, (b) developing a set of assessment 
dimensions based on the position analysis, and (c) de- 
veloping a set of simulation exercises to tap those dimen* 
sions. To assure content validity for the assessment 
center process, these three steps must be carried out to 
meet two critically important objectives: 

1. The assessment dimensions must be closely tied to 
job effectiveness. They must reflect attributes and 
behaviors that are clearly necessary for high levels 
of performance on the job. 

2. The exercises must be closely tied to these dimen- 
sions. They must simulate job conditions and elicit 
behaviors that resemble actual job behaviors. 

Only if both of these objectives are met can we say with 
any assurance that a candidate's performance during an 
assessment center exercise is a reasonable indicator of 
the likelihood that he or she will perform effectively on 
the job. The procedures we carrie:! out in the present 
study to develop police assessment center exercises were 
designed to accomplish these two objectives. 
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B. Development of the Assessment Dimen- 
sions 

. As discussed in the report of our first year*s research 
on this project (Heckman, Groner, Dunnette, & Johnson, 
1972), we began by undertaking an extensive series of 
interviews and workshop meetings with police officers 
and officials to establish a sound foundation for the 
project. As a result of interviews with top officials in 32 
police departments located in small, medium, and large 
cities throughout the country, we chose to study four key 
police officer functions in great detail, including the job 
functions of patrol officer, detective, sergeant, and in- 
termediate commander (lieutenant and captain). These 
interviews, coupled with intensive analyses of the Inter- 
nal Affairs Unit in the Minneapolis Police Department 
and published information from several other depart-* 
ments, yielded an enumeration and classification of police 
failure. With this background information about police 
jobs and cause of police failure, we conducted an exten- 
sive series of workshops with Minneapolis police officers 
(over 100 in all) in the four functions mentioned above to 
gather information about the basic dimensions of police 
officer effectiveness. Since these procedures have been 
presented in full detail in our first years report 
(Heckman et al., 1,972), they are summarized only 
briefly here. 

Participants in each workshop included incumbents 
and immediate superiors of the police function under 
discussion. Thus, patrol officers and sergeants partici- 
pated in the Patrol Officer Workshop, detectives and 
detective supervisors in the Detective Workshop, 
iitTgeants and Hputenants in the Sergeant Workshop, and 
lieutenants and captains in the Intermediate Commander 
Workshop. These participants wrote a large number of 
critical incidents of police officer performance (over 400 
incidents in each of the four functions) and discussed 
possible dimensions of job behavior underlying an 
officer's performance. 

The incidents were then edited by our staff to make 
them more understandable and to cull out incidents that 
did not involve behavior. Once all the incidents were 
„_ edited, four or five staf£members read.each incident,.and 
using the dimensions suggested by the workshop par- 
ticipants, they each developed a set of job behavior 
categories that seemed to encompass all the incidents. 
Four or five participants (police-officers) subsequently 
reviewed and discussed the categories we developed. 
Their discussion resulted in a final set of categories or 
dimensions. 

After developing performance rating scales for the 
dimensions, we tried them out on a pilot basis in rating 
the job performance of incumbent police officers in -De- 
troit, Dallas, and suburban communities near Min- 



neapolis. Forty-four eitizeris in the Tmn Cities area 
participated in a wo ;?op to discuss the relevance of 
these dimensions fo :; icting their experiences with 
police officers. Rest: % m these pretests and discus- 
sion groups sugges- \' At dimensions, with minor 
revisions and elaboi v i Are broadly applicable for 
describing job perforn. • ^f officers in the four police 
functions chosen for thL >oject. 

The assessment dimensions which we used as a basis 
for developing simulation exercises come directly from 
the police performance dimensions developed by the 
procedures outlined above. Our assessment dimensions 
are thus firmly rooted in actual, on-the-job behaviors 
portrayed in the hundreds of critical incidents of police 
effectiveness developed by officers intimately familiar 
with the four police functions under study. They have 
been reviewed and discussed by police officers in police 
departments located in large, medium, and small cities in 
different parts of the country. Therefore, the assessment 
dimensions are cloi^dy tied to actual police officer per- 
formance and represent aspects of police behavior criti- 
cally important for job effectiveness. The assessment 
dimensions, which are fully defined in the report of our 
first year's research (Heckman et al., 1972), appear in 
the following for the four police functions: 

1. Patrol Officer. 

m Crime prevention 

• Investigating, detecting, and following up on 
criminal activity 

• Using force appropriately 

• Dealing constructively with the public 

• Handling domestic disputes 

• Traffic maintenance and control 

• Maintaining public safety and giving first aid 

• Integrity and professional ethics 

• Commitment, dedication, and conscientiousness 

• Teamwork 

• Report writing 

2. Detective 

m Investigating the scene of a crime 

• Arrest, search, and seizure 

• Interrogating suspects 

• Investigating a case 

• Developing and utilizing informants 

• Report writing and paperwork 
« Appearing in court 

• Public relations 

• Dealing with juveniles 

• Cooperating with other officers ano divisions 

• Conscientiousness and dedication 

• Integrity and honesty 

3. Sergeant 

m Concern for subordinates 
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• Scheduling, coordination, deployment, and 
manpower allocation 

• Supervision 

• Performing administrative and inspection func- 
tions 

• Decision making and initiative where no firm 
guidelines exist 

• Training and planning 

• Integrity, dedication, and conscientiousness 

• Dealing effectively with the public and superiors 
4. Intermediate commander, 

• Administrative duties 

• Communications 

• Scheduling 

• Training 

• Supervision 

• Commending, disciplining, and assigning effi- 
ciency ratings 

• Field command situations 

• Public and community relations 

• Dedication, integrity, setting an example 

C. Development of the Simulation Exercises 

As a first step, PDl staff members spent three days 
observing Minneapolis police officers performing their 
job activities. One staff member observed Minneapolis 
detectives, another observed sergeants, and a third ob- 
served lieutenants and captains. Dr. Robert Flint, who 
worked with us as consultant to develop simulations for 
Patrol Officer candidates, has had extensive experience 
working with Minneapolis patrol officers and therefore 
was already familiar with their day-to-day activities. Our 
observations of Minneapolis officers were extremely 
helpful in suggesting ideas for realistic situational exer- 
cises tapping important job aspects ol these police func- 
tions. 

We contacted several agencies and cities that had 
developed their own police assessment centers to learn 
about their exercises, staffing, and methods for analyzing 
and interpreting data, including the New York City 
Police Department, the Kansas City Police Department, 
and lACP. A staff member visited and observed the New 
York Police Department Assessment Center for Inter- 
mediate Commanders. 

After observing the day-to-day activities of Min- 
neapolis police officers and learning more about assess- 
ment centers developed for police departments in other 
cities, our staff developed tentative and preliminary ideas 
for exercises simulating important aspects of police work 
reflected in the assessment dimensions for the four police 
functions. We developed a total of 55 preliminary ideas. 
They were prepared with enough detail to describe the 
outlines of simulations that could be more completely 



elaborated in a subsequent stage of our research. 

To assure that when fully developed bur simulations 
would be appropriate for police officer candidates and 
would be accurate and realistic abstractions of the work 
activities of patrol officers, detectives, sergeants, and 
intermediate commandei^;, we asked nine leading police 
psychologists and police officials to review our prelim- 
inary simulation ideas. Their names are listed below: 

Sgt. Richard Milne 

Office of Personnel and Training 

Tucson Police Department 

Robert B. Mills, Ph.D. 
Professor of Psychology 
Department of Criminal Justice 
University of Cincinnati 

Michael Roberts, Ph.D. 
Director, Psychological Services 
San Jose Police Department 

Lt. Robert A. Schwartz 
Planning and Research 
Bureau of Police 
Portland, Oregon 

T. Eisenberg, Ph.D. 

Police Psychologist 

San Jose Police Department 

Brian S. O'Leary, Ph.D. 
Personnel Psychologist , 
Washington, D. C. Police Department 

Pierce R. Brooks 

Director, Department of Public Safety 
Ijakewood, Colorado 

Martin Reiser, Ph.D. 

Department Psychologist 

Los Angeles Police Department 

Capt. James Shaw, Ph.D. 

Personnel and Training Division 

King County (Washington) Dept. of Public Safety 

These individuals received descriptions of cur pre- 
liminary simulation ideas by mail, together with defini- 
tions for the assessment dimensions in the four polic-J 
functions. They were asked to: 

• Review the perforiYtance dimension definitions for 
each function. 
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• Review our ideas for simulations tapping these per- 
formance dimensions. 

• Comment on how appropriate and realistic our 
simulation ideas are in terms of the way things 
actually happen in police departments. If a situa- 
tional exercise or some aspect of it violates standard 
operating procedures, how should we change it? 
What kinds of background information and cir- 
cumstances can we add to make the simulations 
more realistic? Do the simulations represent typical 
and important activities in the day-to-day work of 
police personnel? Would candidates, especially 
those with little or no experience in the particular 
function for which they are being assessed, consider 
the simulations fair tests of their abilities? How 
much time should be devoted to each simulation 
when used in an operational assessment center? 

• Suggest additional details that will help our simula- 
tions reflect - the performance dimensions more 
clearly. Also, suggest how we can modify the simu- 
latioss so that each will reflect a wider range of 
performance dimensions. 

• Suggest their own ideas for . situational exercises 
tapping the performance dimensions. 

Their written comments contained many helpful 
suggestions for improving the exercises. They offered 
suggestions about specific details that were not appro- 
priate, ideas for additional simulations, and ideas for 
how we could enlarge the scope of some of our Simula- 
tions to include a wider range of assessment dimensions. 

Working from written comments of the police 
psychologists and police officials, PDI staff members 
selected the most promising seven to ten simulation ideas 
for each of the four police functions. These were more 
fully elaborated with instructions for candidates and as- 
sessors and background details to lend realism. We pre- 
pared complete instructions to be given to candidates 
prior to their participation in the. simulations; instructions 
for assessors on how to administer the exercises, set up 
phsyical props, and observe candidates' performance 
during the exercises; and details regarding background 
information to be provided to candidates to make the 
simulations as realistic as possible. 

Then we invited 1 1 police psychologists and police 
officials from cities across the country to a one-day 
conference in Minneapolis to discuss our simulations and 
make suggestions for improving them. The list of con- 
ferees, some of whom had already reviewed our prelim- 
inary ideas for exercises, appears below: 

Captain Allan Hoehl 

Advancement and Promotion Stciion 

New York City Police Department 
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Robert B. Mills, Ph.D. 
Professor of Psychology 
Department of Criminal Justice 
University of Cincinnati 

Police Chief Donald Deming 
Winnetka, Illinois Police Department 

Inspector Myron H. Blanch 
Director of Training Division 
Minneapolis Police Department 

David L. Gorski, Director 
Department of Public Safety 
Village of Golden Valley, Minnesota 

Michael Roberts, Ph.D. 
Director, Psychological Services 
San Jose Police Department 

Lt. Robert A. Schwartz 
Planning and Resea ch 
Bureau of Police 
Portland, Oregon 

T. Eisenberg, Ph.D. 
Police Psychologist 
San Jose Police Department 

Brian S. O'Leary, Ph.D. 
Personnel Psychologist 
Washington, D. C. Police Department 

Pierce R. Brooks 

Director, Department of Public Safety 
Lakewood, Colorado 

Martin Reiser, Ph.D. 
Department Psychologist 
Los Angeles Police Department 

All our simulations were thoroughly discussed during 
this conference. The attendees commented on the realism 
of the simulations, the extent to which simulations con- 
formed to standard operating procedures in different 
police agencies, how police candidates could be ex- 
pected to react to the exercises, and what kinds of be- 
havior to look for in the exercises to distinguish candi- 
dates who perform effectively on the assessment dimen- 
sions from those who perform ineffectively. Also, the 
attendees made many valuable comments regarding the 
probable level of difficulty of the exercises for candidates 
and how to alter simulations to make them more realistic. 



technically correct, and administratwely workable. Their 
inputs at this stage in the development of the simulations 
were crucial for assuring thut the exercises would simu> 
late actual, on-the-job activities of putrol officers, detec- 
tives, sergeants, and intermediate commanders. 

As a result of this conference, some exercises were 
eliminated because they seemed inappropriate or ad- 
ministratively unworkable to the police psychologist and 
police officials attending the one-day conference. Some 
exercises were combined as a result of their comments. 
And still other exercises were conceived during the con- 
ference as a result of their suggestions for new, addi- 
tional simulations. PDl staff members continued the pro- 
cess of fleshing out the simulations with full details and 
complete instructions for both assessors and caiKlidates. 
At this point, we had a total of 30 completely elaborated 
simulations, eight for Patrol Officer candidates, eight for 
Detective candidates, five for Sergeant candidates, and 
nine for Intermediate Commander candidates. 

While preparing simulations for the patrol officer func- 
tion, it soon became apparent that because candidates for 
Patrol Officer jobs may have had little or no prior experi- 
ence or training in police work, they would probably 
need special introductory orientation before taking part 
in exercises realistically simulating aspects of the patrol 
officer^s job. Accordingly, we took steps to develop 
introductory training materials for Patrol Officer candi- 
dates. Captain Myron Blanch, Director of the Training 
Division of the Minneapolis Police Department, worked 
with us to prepare training materials consisting of a series 
of brief lecturettes on the following aspects of patrol 
work reflected in the patrol officer simulations: law en- 
forcement code of ethics, dealing constructively with the 
public, first aid, traffic maintenance and control, use of 
force, crime prevention, the preliminary investigation, 
and report writing. 

Our strategy was to precede the actual testing of Patrol 
Officer candidates with a brief "'micro-training** session 
to last approximately 2 hours. During this introductory 
session, candidates would be acquainted with some of 
the principles and procedures of the patrol officer's job. 
They would not be trained in any comprehensive man- 
ner, but rather provided with a general awareness of what 
the correct, prescribed behaviors are so that their perfor- 
mance during the simulation exercises can be more 
meaningfully observed and evaluated. 

Even with these introductory micro-training materials, 
we felt that some aspects of patrol work were so inhe- 
rently difficult that they should not be simulated too 
realistically for Patrol Officer candidates who did not 
have the benefit of extensive police academy training. 
For example, handling doraestic disputes and knowing 
when and how to apply appropriate degrees of force were 



considered areas that woutd be particularly unfair to 
stage with inexperienced, untrained candidates interact- 
ing in a simulation exercise with live actors. We decided, 
therefore, to use a videotaped segment showing two 
patrol officers handling a domestic disturbance and using 
varytr.g ,1egrees of force. Rather than have candidates 
actually interact with live actors simulating a domestic 
disii.ib?:ice, we planned to have them observe the vid- 
eotapf;d simulation, evaluate the performance of the two 
officers shown on the tape, and indicate what they think 
they would have done differently if they were the officers 
on the tape. 

We obtained a copy of a training tape developed by the 
Minneapolis Police Department showing a simulation of 
two patrol officers (acted by two Minneapolis police 
officers) handling a domestic disturbance (acted by two 
professional actors). 

We also developed a second videotaped simulation 
showing two police officers responding to a call from a 
frightened woman claiming to have heard a prowler. 
This tape was prepared primarily to simulate the patrol 
officer assessment dimensions of Crime Prevention; In- 
vestigating; Detecting, and Following Up on Criminal 
Activity; and Dealing with the Public. Two Minneapolis 
patrol officers played the parts of patrol officers respond- 
ing to the call and a professional actress was hired to play 
the role of the frightened woman. Captain Myron Blanch 
and the Minneapolis Police Department provided techni- 
cal assistance during the production of this videotape 
simulation. 

The next step was to take the simulations off the 
drawing board and actually try them out with police 
officers in the four police functions. Police departments 
in Minneapolis, Des Moines, and Cincinnati generously 
agreed to cooperate with us in this stage of the develop- 
ment of the simulations. 

We scheduled a total of 77 police officers in these 
three cities to participate in the pretesting of the simuia 
tion exercises. Table 62 shows the distribution of par- 
ticipants scheduled according to function and city. Of the 
77 officers who were scheduled to participate, only ap- 
proximately five or six failed to show up at th^appointed 
times for their session. The officers participated for vary- 
ing lengthv« of time, from 2 to 8 hours depending on what 
specific simulation exercises were scheduled for them. 

The participating officers were either n^wly promoted 
(within the past several months) to the function in which 
they were scheduled to participate as prstest subjects, or 
they were candidates eligible for promotiion to that func- 
tion. Thus participants in the Intermediate Commander 
pretests were newly promoted lieutenants and captains 
and experienced sergeants eligible for promotion to 
lieutenant; participants in the Sergeant pretests were 
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Table 62 



Distribution of Police Officers Scheduled to Participate 
!ft the Pretesting of the Simulation Exercises, 
According to City and Police Function 



Police Function 

Patrol Intermediate 

City Officer Detective Sergeant Commander Totals 

Minneapolis 6 7 6 6 25 

Cincinnati 6 7 10 4 27 

Dcs Moines 4 8_ 4 • 25 

Totals 16 22 25 14 77 



newly promoied sergeants and experienced patrol offic- 
ers eligible for promotion to sergeant; participants in the 
Detective pretests were newly promoted detectives and 
patrol officers eligible for promotion to detective/ 
investigator; and participants in the Patrol Officer pre- 
tests were new patrol officers, police cadets with cadet 
training and several months of experience as cadets, and 
community service officers who also had some police 
training and experience but not formal police academy 
training or experience as full patrol officers. Several 
women and blacks were included among the officers 
participating in the pretests. 

A PDI staff member began each preees; session by 
explaining the background and purpose of the project and 
enlisting the participants* help in further developing the 
simulations to assure that they would be realistic and fair 
tests for Police Officer candidates. PDI staff members 
administered instructions for each exercise and assumed 
roles that would be played by assessors in the role-play 
simulations. 

There was no attempt to evaluate the effectiveness or 
ineffectiveness of participants who performed the simu- 
lations during this pretest. Rather, participants were in- 
terviewed at the end of each exercise and asked for their 
reactions. They were asked questions such as the follow- 
ing: 

• Were the instructions clear? Was there any confu- 
sion about what they were to do during the exer- 

;:2,e? 

• Was there too much or not enough time allotted for 
the exercise? 

• Did the exercise seem too difficult or too easy? 
Would it seem too difficult or too easy for candi- 
dates with no training or experience in the particular 

^ police function represented in the simulation? 
Should the amount of time allotted to the exercise or 
the complexity of the content of the exercise be 
altered to make the exercise easier or, conversely, 
more difficult for candidates? 

• Were details of the content of the exercise realistic 
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and technically correct? Were all the technical 
terMs appropriate for their particular police depart- 
ment? Did the content of the exercise violate stan- 
dard operating procedures in their department? 
Would inexperienced candidates understand the 
meaning of technical terms? 
«• Could they suggest any changes in tho administra- 
tion, instructions, or content of the exercise? 
o Was there anything about the adir-inLstration, in- 
structions, or content that might be v aiiMT to women 
or minority candidates? 
By the end of these pretest sessions, o/ the 30 
simulations had been performed by an average of approx- 
imately six police officers. Their comments and reactions 
during and after the simulations were rich in suggestions 
for altering various details and improving the exercises. 
By and large, they seemed to feel that the simulations 
were generally realistic portrayals of police officers' jobs 
and that when used in combination Ihe simulations would 
be regarded by candidates as fair tests of their abilities 
and potential for effectiveness. 

After pooling their observations of reactions 
comments made by participants in the pretests, PDI staff 
members once again revised the simulations. Instructions 
were modified for added clarity; details of the content of 
exercises altered for added realism; more or less time 
allowed for performing certain exercises for a more ap- 
propriate level of difficuhy; and a few exercises dropped 
or replaced because they proved too unrealistic, too 
complex, too obvious, or too administratively awkward 
to be workable. These revised simulations included 
seven for* Patrol Officer candidates, seven for Detective 
candidates, five for Sergeant candidates, and seven for 
Intermediate Commander candidates. In all, 26 simula- 
tions were finally developed. In addition, standardized 
background interview protocols were prepared to sup- 
plement the simulation exercises. 

To summarize, PDI staff members developed 26 exer- 
cises simulating important aspects of police work in the 
functions of patrol officer, detective, sergeant, and in- 



termediate commander by carrying out the following 
steps: 

• Minneapolis police officers were observed as they 
performed their day4*>day job activities. 

• Informatiori about the exercises and administration 
of other poHce assessment centers was obtained. 

• Preliminary ideas for 55 simulation exercises were 
prep.^rcd to tap aspects of police work reflected in 
the dimensions of police officer performance de- 
veloped earlier dunng this research project. 

• The simulation ideas were revised and more fiilly 
elaborated according to the written comments of 
nine police psychologists and police officials from a 
variety of police departments across the nation. 

• The simulations were further revised according to 
the inputs of 1 1 police psychologists and police 
officials who attended a one-day conference in 
Minneapolis. 

• Introductory micro-training materials and vid- 
eotaped simulations were prepared for Patrol 
Officer exercises. 

• The simulations were pretested with approximately 
70 poUce officers in Minneapolis, Dcs Moinef>, and 
Cincinnati. 

• The simulations were again revised according to the 
results of the pretests. 

This process resulted in the final development of 26 
simulation exercises for candidates seeking selection or 
promotion to Patrol Officer, Detective, Sergeant, or In- 
termediate Commander. 

D. Catalogue of Simulation Exercises 

The 26 simulation exercises and related materials de- 
veloped for the four police functions are summarized 
briefly in the following and on subsequent pages. (Full 
details about the content of these exercises are provided 
in the Assessor's Manuals which are included as appen- 
dices to this report.) 

I . Exercises and materials for patrol officer candi- 
dates. 

a. Micro-training materials. Candidates receive 
booklets containing brief lecturettes on the following 
aspects of the patrol officer's job: law enforcement code 
of ethics, dealing constructively with the public, first aid, 
traffic maintenance and control, use of force, crime pre- 
vention, the preliminary investigation, and repon writ- 
ing. Candidates are instructed to read along quietly as 
they listen to to the lecturettes presented on a cassette 
tape. . 

b. Domestics. In this exercise, candidates view a 
videotaped segment showing two patrol officers handling 

_a domestic dispute. The tape is stopped at specific points 
and the candidates evaluate the performance of the two 



officers with instructions to indicate how they would 
have acted if they were the officers in this situation. After 
the tape is shown, candidates as a group discuss the 
officers' performance and try to achieve a consensus on 
the effectiveness of the performance of the officers in the 
videotaped segment. 

c. Frightened woman. This is a second exercise in 
which candidates respond to a videotaped simulation. As 
in the --.domestics" exercise, the tape is stopped at 
specific, points and candidates evaluate the performance 
of the officers on the videotaped simulation. Then, as a 
group they discuss and evalute the officers. 

d. Precinct desk. The Precinct Desk Exercise simu- 
lates two telephone calls from citizens to a police pre- 
cinct. Candidates listen to a recording of these calls and 
hear the patrol officer at the precinct desk talk with the 
citizen callers. At several points, the recording is su)pped 
and candidates are instructed to write down what they 
would say next if they were the officer at the desk taking 
the call. 

e. Traffic stop. This is a role-play exercise in which 
the candidate assumes the role ot a patrol officer about to 
issue a citation to a driver, role-played by the assessor, 
for failing to stop at a stop sign. 

f. Hotel call. The Hotel Call is a role-play exercise 
in which the candidate assumes the role of a patrol 
officers dispatched to a hotel where someone who is 
afraid he may have hurt himself has called the police for 
help. The injured party is role-played by the assessor. 
After interviewing the victim, the candidate then writes a 
report of the incident. 

g. Burglary, This is a role-play exercise in which 
the candidate assumes the role of a patrol officer sent to 
answer a call from Mr. Smith, a citizen role-played by 
the assessor, who called the police because his hotel 
room was burglarized. The candidate must go through a 
few steps of preliminary investigation and then write a 
report of this incident. 

h. Profe:iSional practices. This exercise has been 
designed primriJ^i' to tap the performance dimension 
"Integrity and iProfessional Ethics." Candidates write 
essay answers to four questions about what would be 
proper for a patrol officer to do in difficult and ambigu- 
ous situations involving the exercise of professional 
ethics. After writing their answers for an hour, they are 
then instructed to discuss these four situations and decide 
as a group what the proper course of action in each 
situation would be. 

{. Background interview. The Background Inter- 
view serves the dual purpose of (a) learning about the 
general background of a candidate to obtain a context for 
interpreting his performance in the assessment center 
exercises, and (b) obtaining information about his per- 



formance or behavior in previous situations that might 
indicate his potential for effectiveness as a patrol officer. 
The candidate is interviewed on his present job, personal 
history, and aspects of his job and life experiences that 
pertain to his potential in specific areas of patrol officer 
job effectiveness. 

2. Exercises and materials for detective cdndidates. 
The first four exercises, the ''Adams Case** exercises, 
are a sequential series of interrelated exercises designed 
to simulate the investigation of a homicide. Candidates 
assume the role of E)etective William Johnson, the detec- 
tive assigned to investigate the case. During the course of 
these exercises, he investigates the initial scene of the 
crime, interviews a witness, interrogates a suspect, 
writes reports of his investigations and interviews, and 
meets with the district attorney, who, to prepare the 
detective for trial, asks him to answer several questions 
as if he were actually on the stand, first under direct 
questioning and then under cross-examination. 

a. Adams case: Crime scene. The candidate is told 
to imagine that as Detective Johnson, he has just arrived 
at the scene of the crime, Marcy Adams' apartment, 
where he was met by two patrol officers. They told him 
that Marcy was found unconscious by her father, George 
Adams, who then called the police. The candidate has 10 
minutes to investigate the scene of the crime. The candi- 
date's task, then, is to learn as much as possible about 
the circumstances leading to Marcy's death by examin- 
ing the bits and pieces of physical evidence in the crime 
scene. 

b. Adams case: Mr, Adams, The next exercise in the 
Adams Case series is a role-play exercise. The candioaie 
has 10 minutes to interview George Adams, Marcy's 
father, who found her unconscious in her apartment and 
called the police. A staff member plays the role of Mr. 
Adams. After examining the crime scene and interview- 
ing Mr. Adams, the candidate writes a report of the 
results of his investigation. Also, he writes what his 
immediate next steps would be in investigating the case. 

c. Adams case: Mr, Fisher. Next, the candidate is 
told that as Detective Johnson, he will interview John 
Fisher, a possible suspect. Fisher is role-played by an 
assessor. The candidate has 15 minutes to questi n 
Fisher. He then writes a report of his interview. 

d. Adams case: District Attorney, In the final exer- 
cise in the Marcy Adams series, the candidate is in- 
structed to imagine that four months have elapsed since 
he began his investigation of the Marcy Adams 
homicide. John Fisher has been arrested and charged 
with her murder; he is being tried in court in two days. 
To prepare Detective Johnson to testify in court, the 
candidate is told, the district attorney has asked to meet 
with him and review the case. A staff member in the role 



of the D. A. begins this exercise by saying that to prepare 
Detective Johnson for the stand, he will first ask him the 
kinds of questions he plans to ask under direct examina- 
tion. Then he will cross-examine him as if he were the 
defense attorney. The candidate, in the role of Detective 
Johnson, is to answer these questions as if he were on the 
stand. 

e. Written cases exercise. The candidate assumes 
the role of Daniel Boyd who has been newly promoted to 
the position of detective in the Homicide-Robbery-Sex 
Division of the Granbury Pol»ce Department. He re- 
ceives files for six robbery cases, some of which have 
been partially investigated by another detective and 
others which have not yet progressed beyond the patrol 
officers' preliminary investigatiotl.' The candidate is told 
that he has been assigned these six cases. He must first 
establish priorities among them and, second, indicate 
exactly how he intends to proceed on each case. 

f. Major case planning exercise. Candidates are 
divided into two groups of two (or two groups of three). 
Candidates in one group are instructed to assume the 
roles of homicide detectives from Granbury; candidates 
in the other group are burglary detectives from Fairfax, a 
nearby city. They are all instructed that a buiglary occur- 
red a few days ago in Granbury in which two patrol 
officers were killed. A similar burglary, unsolved, occur- 
red in Fairfax several months earlier^ Each group of 
candidates is given a detailed summary only of the crime 
which occurred in their own respective cities. The two 
groups are to meet £s one team to plan an inter-city, 
cooperative investigation of these two crimes. 

g. Burglary, The candidate assumes the role of 
James Hanson, a burglary detective investigating a series, 
of household burglaries. The candidate is told that during 
the course of his investigations he learns that Tommy 
Miller, a juvenile, may be implicated as a suspect. The 
candidate's task is to interview Tommy's father, Mr. 
William Miller, role-played by the assessor. The candi- 
date must then write a report of the interview. 

h. Background interview. The Background Inter- 
view serves the dual purpose of (a) learning about the 
general background of a candidate to obtain a context for 
interpreting his performance in the assessment center 
exercises and (b) obtaining information about his per- 
formance or behav'or in previous situations that might 
indicate his potential for effectivenjsss as a detective. The 
candidate is interviewed on his present job activities, 
personal history, and specific aspects of his performance 
in his present job that pertain to his potential for effec- 
tiveness as a detective. 

3. Exercises and materials for sergeant candidates, 

a. In-basket exercise. The In-basket Exercise simu- 
lates the kind of administrative paperwork a police 



sergeant would have to process. The candidate assumes^ 
the role of Bill Smith, newly promoted to sergeant, 
replacing Sergeant Boyd who died suddenly last week. 
As Sergeanz Smith, the candidate must take action on a 
number of leUers, memos, and miscellaneous administra- 
tive matters that have accumulated in Sergeant Boyd's 
in-basket. 

p. Interview with Officer Kimple. This is a role- 
play exercise in which the candidate assumes the role of 
Sergeant Bill Smith. His task is to meet with one of his 
subordinates. Officer Howard Kimple, who made ah 
appointment with Smith through Lt. Marvin of the Per- 
sonnel Department. Kimple is exploring the possibility 
of leaving his job for another one with a suburban police 
department and he wants to approach his boss, Sgt. 
Smith, for advice. The exercise presumes that the candi- 
date is already somewhat familiar with information about 
Kimple presented in the In-basket Exercise, although he 
receives the relevant information again for this inter- 
view. The Kimple Interview, therefore, should follow 
the In-basket Exercise in the Sergeant Assessment Cen- 
ter. 

c. Interview with Officer Ryan, This is another 
role-play exercise in which the candidate assumes the 
role of Sergeant Bill Smith. His task is to interview one 
of his subordinates. Officer John Ryan, who is role- 
played by the assessor. There are several indications that 
Ryan's performance is going downhill and that he has 
taken to drinking while on duty. This exercise presumes 
that the candidate is already somewhat familiar with 
information about Ryan presented in the In-basket exer- 
cise although he receives the relevant information again 
"for his exercise. The Ryan interview, therefore, should 
follow the In-basket Exercise in the Sergeant Assessment 
Center. 

d. Supervisory style discussion. In this exercise, 
. candidates discuss supervisory styles of police sergeants. 
" As a group, candidates are to agree on a particular style 

which is generally more appropriate for police sergeants 
and und:" what specific circumstances other styles 
should be used, if at all. 

e. Training exercise. Candidates are instructed to 
develop porposals for a J.-hour training program or 
module. They are told to imagine that they will be 
entering their proposals in the 'Tive-State Police As- 
sociation" competition. One proposal, from among 
those developed by the candidates, will be chosen as the 
one most deserving to be funded. Candidates can spend 
as much time as they wish during the evening of the first 
day of the assessment center (the assessment center for 
sergeant candidates lasts IVi days) to prepare a course 
outline which will constitute thcif training proposal. On 
the next day, each candidate presents his proposal to the 



others in a formal, stand-up presentation. Then candi- 
dates discuss all the proposals and reach a consensus on 
the rank order of the training proposals according to their 
quality. 

f. Background interview. The Background Inter- 
view serves the dual purpose of (a) learning about the 
general background of a candidate to obtain a context for 
interpreting his performance in the assessment center 
exercises and (b) obtaining information about his per- 
formance or behavior in previous situations that might 
indicate his potential for effectiveness as a sergeant. The 
candidate is interviewed on his present job activities, 
career aspirations, personal history, and non-work ac- 
tivities. 

4. Exercises and materials for intermediate comman- 
der candidates. 

a. Background Information: Precinct Comman- 
der's files. The Intermediate Commander Center exer- 
cises are set within the context of a precinct in the 
hypothetical city of Fairfax. During an introductory 
orientation session preceding the actual simulation exer- 
cises, candidates are given a packet of background in- 
formation (Precinct Commander's files) on the hypothet- 
ical precinct and city. These materials are briefly re- 
viewed with the candidates in the orientation session. 
Candidates retain the materials for reference throughout 
the assessment center. They are collected at the end of 
the last exercise. 

b. In-basket exercise. This exercise Simulates the 
administrative work of a precinct commander. The can- 
didate assumes the role of Capt. Frank Roberts of the 
Eastside Precinct and receives a packet of materials 
comprising the in-basket accumulation left by Roberts' 
successor. Within a set period of time, the candidate 
must process these materials in the most effective way 
possible. In other words, he must make decisions, dele- 
gate, schedule, analyze reports, and communicate with 
subordinates, superiors, and the public. 

c. Background interview.' The Background Inter- 
view serves the dual purpose of (a) learning about the 
general background of a candidate to obtain a conte"s:(o; 
interpreting performance in the assessment center exer- 
cises and (b) obtaining information about performance or 
behavior in previous situations that might indicate the 
candidate's potential for effectiveness as an intermediate 
commander. The candidate is interviewed on present job 
activities, personal history, specific and pertinent as- 
pects of present job performance, career aspirations, and 
non-work job activities. 

d. Lt. Pete Estes interview. In this role-playing 
exercise, the candidate is asked to assume the role of 
Capt. Frank Roberts and conduct a performance apprai- 
sal interview with Lt. Estes. The former precinct com- 



mander, Capt. Groton, has completed the annual per- 
formance rating form before his death, and the candidate 
n^ust discuss these ratings with Estes according to de- 
partment policy. In order to do this, the candidate is 
given several pieces of information in addition to the 
current ratings, such as Estes' personnel file and memos 
from the in-basket. 

e. Training presentation to recruit class. This is a 
group presentation exercise in which each candidate is 
asked to present a 10-minute training talk to a recruit 
class made up of staff and other candidates. Thus, the 
candidate must develop a talk that will hold the ''re- 
cruits" interest; while at the same time giving them 
useful knowledge. 

f. Sgi, John Simpson exercise. The candidate is 
again asked to assume the role of Capt. Frank Roberts 
and must interview a formerly top-notch sei'geant who 
has lately been doing a very poor job. Staff assessors 
play the role of the sergeant, John Simpson. 

g. Field command exercise. This is an individually 
written exercise designed primarily to tap the perfor- 
mance area of field command. Candidates are again 
asked to assume the role of Capt. Frank Roberts of the 
Eastside Precinct, and are then given a packet of com- 
munications designed to test their judgment under time 
pressure. The candidates write down all actions they 
would take to each item and these actions are sub- 
sequently analyzed by staff members. For convenience, 
the exercise is usually given in a group setting since 
written communications received by the candidates must 
be timed with a stopwatch. 

h. Precinct reorganization exercise. l*he candidate 
again- takes on the role of Capt. Frank Roberts and must 
complete two assignments. The first is cued by a memo 
from the Chief indicating that hf. wishes each precinct 
commander to reorganize his precinct according to cur- 
rent crime statistics, taking into account budget restric- 
tions, operational models used by other cities, of^cer 
morale, training, and community relations. While the 
candidate has some suggestions given to him, he may 
complete the assignment in several ways, thus allowing 
an assessment of his analytical skills and police know- 
ledge, his use of all available information, and his ability 
to formulate a clear recommendation. Secondly, the 
exercise requires the candidate to conduct a staff meeting 
with his ''subordinates" to enlist their suggestions and 
assistance with his reorganization. 

i. Precinct Commander group discussion. Candi- 
dates are asked individually to formulate a plan to deal 
with a community relations problem and then reach a 
group consensus on the most effective solution. After the 
group discussion they (again individually) incorporate 
the results of the meeting into a press release for the city 



newspaper. Newspaper articles and incident reports are 
given to the candidate, along with a memo from the 
Chief with additional inputs. 

We tried to fashion the stimulus materials associated 
with the exercises to be as realistic as possible. It would, 
of course, be possible to go even further than we did to 
devise additional details in some of the materials. For 
example, in the In-basket exercise items for sergeants 
and intermediate commanders and in the Written Cases 
items for detectives, it would be possible to make the 
memos, letters, reports, and other paperwork items seem 
more realistic by printing them on "official" forms and .; 
by including official lettertieads where appropriate. Since 
the format of official forms^ such as offense reports and 
letteriieads, vary from one police department to another, 
it might be useful to have them printed specifically for 
the location of the testing when the assessment center 
simulations are used operationally. 

Also, the videotapes used for some of the Patrol 
Officer exercises might be improved if financial re- : 
sources were available to utilize more elaborate staging ' 
and highei quality technical production. The ^videotapes : 
we developed and used seemed adequate, but vhore tech- : 
nically perfect tapes could be produced at a higher cost. 

Tables 63 through 66 summarize the exercises de- 
veloped for the four police functions by listing the exer- 
cises and showing what assessment dimensions they 
were designed to tap. When selecting a set of exercises 
for an assessment center, the exercises that seem to tap 
the dimensions of greatest interest should be given the 
strongest consideration. 

E. Pilot Tests of Police Assessment Centers 

Once the simulation exercises had been individually 
pretested with police officers and revised accordingly, 
the next step was to assemble simulations into coherent . 
packages for use in complete assessment centers of from 
1 to 2 days in duration. We planned to train persons to 
serve as assessors and then to conduct two pilot assess- 
ment centers for each of the four police functions. 

In preparation for the pilot centers, PDI staff de- 
veloped videotaped recordings of all role-play simula- 
tions in the catalogue of simulations. They included the 
Traffic Stop, Hotel Call, and Burglary simulations for 
Patrol Officer candidates; the Adams Interview^ Fisher 
Interview, District Attorney Interview, and Burglary 
simulations. for Detective candidates; the Kimple Inter- 
view and Ryan Interview simulations for Sergeant candi- . 
dates; and the Estes Interview and Simpson Interview 
simulations for Intermediate Commander candidates. 
Each role-play simulation recorded on videotape was : | 
performed by two Ppi staff members who were familiar 
with the role requirements and who had extensive ex- : ■ 



Table 63 



Assessment Dimensions Taped by the Patrol Officer Exercises 



Assessment 
Dimensions 


DOMESTiCS 
EXERCISE 


FDinUT 

rKiun 1 - 

ENED 
WOMAN 


PRECINCT 
DESK 


TRAFFIC 
STOP 


HOTEL 
CALL 


BURGLARY 
EXERCISE 


PROFES- 
SIONAL 
PRACTICES 


BACK- 
GROUND 
INTERVIEW 


1. Crime 
Prevention 




X 


/a 












2. Investigating, 
Detecting 




X 


X 




X 


X 






3. Usrng Force 
Appropriately 


X 














X 


4. Dealing with 
the Public 




X 


X 


. 

X 


X 


X 




X 


5. Domestic 
Disputes 


X 














X 


6. TrafHc 
Maintenance 








X 








X 


7. Public Safety 










X 






X 


8. Integiity, Ethics 














X 


X 


9. Commitment 


10. Teamwork 


X 


X 














1 1 . Report Writing 


X 


X 






X 


X 


X 





perience in similar role-play situations for other asses, 
ment center exercises. In each case, one PDJ s.sh 
member assumed the role that would be playf;c{ by t:jc 
candidate undergoing assessment and another stuil 
member assumed the role that would be played by the 
assessor. 

These videotaped role-play simulations were prepared 
primarily to provide a standard with which to train as.ses- 
sors on how to play the assessor's role in these exercisc:s. 
At the same time, the tapes were intended to help train 
assessors on how to observe ;ind evaluate a candidate*s 
performance during ihe rolc-piay simulations. That is, 
trainee assessors would be asked not only to observe the 
person in the role of the assessor to see how the role 
should be played, but also io observe the person in the 
role of the candidate to practice evaiu^tinj^ and rating 
candidates* performance. 

PDI arrangecf to conduct piiot centers in four different 
cities so that ta;- i*enters would be tested for their appro- 
priateness in pt^iice departments serving cities that dif- 
fered greatly i:i ^Atz, geograpK:al location, and other 
characteristics. We conducted pilot centers in Chat- 
tanooga, Tennessee; Portland, Oregon; Washington, D. 
C; and Minneapolis, Minnesota. Table 67 sho^vs ^ow 
the eight pilot centers were distributed among these four 
cities. As shown in Table 67, we conducted a total of 



eight pilot assessmc^ni centers — two in each police func- 
tion and two in each city. 

Each pilot center was stafed by three assessors under 
the overall guidance and adoiinii-tration of a PDI staff 
ir^ember. In each case, one assessor was a high-ranking 
police official at the level of captair. or above in the 
police department hosting the center and providing can- 
didate officers; one was a local psychologist from the city 
in which the center took pli'^^e; and one was a local 
citizen working in areas like social work, religious minis- 
try, or some other profession intimately concerned with 
police services from the "consumer' ' perspective of citi- 
zens. This mix of backgrounds among assessors was 
accomplished to assure that Police Officer candidates 
would be fairly assessed by persons with professional 
skills in psychology, police work, and social or commun- 
ity service work. A total of \% assessors Were eventually 
trained. Six were trained for the Intermediate Comman- 
der CenUtti . six for the Sergeant Centers, and;six for 
both the Piiirol Officer and Detective Centers. 

Candidates who volunteered to vake pail in the as- 
sessment center exercises were paid for their participa- 
tion. Thret candidates were as.«.essed in e^ch pilot center. 
For the two Patrol Officer Craters, participating candi- 
dates v/ere citizens who showed an interest in applying 
for positions as patrol offi^.cTs bu^ >ho as yet had no 



T^lBLE 64 





Assessment Dimensions Taped by the Detecti . 


t.urcises 






Assessment 
Dimensions 


CRIME SCENE MR. HSHER DISTRICT WRITTEN 
& MR. ADAMS EXERCISE ATTORNEY CASES 


MAJOR 
CASE 
PLANNING 


BURGLARY 
EXERCISE 


BACK- 
GROUND 
INTERVIEW 


1. iDvestijgating 
the Scene 


X • 






X 


2. Arrest, Search, 
and Seizure 


X X 






X 


3. Interrogating 
Suspects 


X X 






X 


4. Investigating 
a Case' 


X X 


X 


X 




5. Developing and 
Using Informants 








X 


6. Report Writing 


X X 




X 


X 


7. Appearing in 
Court 


X 






X 


8. Public Relations 


X X X 








9. Dealing with 
Juveniles 


X 




X 




10. Cooperating with 
Other Officers 


X X 


X 




X 


11. Conscientiousness 
and Dedication 


X X X 






X 



12. Integrity and 
Honesty 



Table 65 

Aisessment Dimf.-.nons Trrcd by the Sergeant Exercises 



Assessment 
Dimensions 


IN- 
BASKET 


omcER 

KIMPLE 


OFFICER 
RYAN 


SUPERVISORY 
STYLE 


TRAINING 
EXERCISE 


BACKOROUND 
INTERVIEW 


1 . Concern for 
Subordinates 


X 




X 


X 


X 


X 


2. Scheduling, 
Coordination 


X 


r 










3. Supervision 


X 


X 


X 


X 




X 


4. Administrative* 
Inspection 


X 




X 






X 


5. Decision Making 


X 




X 


X 


X 


X 


6. Training & Planning 


X 






X 


X 


X 


7. Integrity 


X 


X 


X 


X 






8. Dealing with Public & 
Superiors 


X 






X 


X 


X 



68 



89 



Table 66 

Assessment Dimensions Taped by the Intermediate Commander Exercises 





Assessmeni 
Dimensions 


IN- 
BASKET 


BACK. 
GROUND 
INTERVIEW 


ESTES 
INTER. 
VIEW 


TRAINING 
PRESEN. 
TATION 


SIMPSON 
EXERCISE 


FIELD 
COMMAND 


PRECINCT" 
REORGANl. 
ZATION 


PRECINCT 
COMMANDER 
DISCUSSION 


1. 


Administralive 
Duties 


X 


X 










X 




2. 


Comniunicaiion s 


X 


X 





X 






X 




3. 


Scheduling 


X 


X 










X 




4. 


Training 


X 


X 


X 


X 


X 




X 


X 


5. 


Supervittjon 


X 


X 






X 


X 




X 


6. 


Commending, 
DiscipHr.ing 


X 


X 


X 




X 






X 


7. 


Field 

Command 




X 








X 






8. 


Public 
Relations 


X 


X 




X 






X 


X . 


9. 


Dedication, 
Integrity 


X 


X 


X 


X 








X 



Table 67 



Cities in Which the Pilot Assessment Centers Were 
Conducted 

• Chattanooga, Tennessee: 

Pilot Center for Intermediate. Commandei Candi- 
dates 

Pilot Center for Sergeant Candidates 

• Portland, Oregon: 

Pilot Center for Intermediate Commander Candi- 
date." 

Pilot Center for Sergeant Candidates 

• Washington, D. C: 

Pilot Center for Patrol Officer Candidates 
Pilot Center for Detective Candidates 

• Minneapolis, Minnesota: 

Pilot Center for Patrol Officer Candidates 
Pilot Center for Detective Candidates 

formal training or experience. Participants in the Detec- 
tive Centers were either newly promoted detectives or 
experienced patrol officers eligible for promotion to de- 
tective; participants in the Sergeant Centers were newly 
promoted sergeants or patrol officers eligible for promo- 
tion; and participants in the Intermediate Commander 
Centers were newly promoted lieutenants and captains or 
sergeants eligible for promotion. Included among the 24 
candidates assessed were 17 white males, 4 black males, 
1 American Indian male, and two white females. 

Each pilot assessment center was conducted in three 
stages: (a) assessors were trained and familiarized with 



the procedures of the center and content of the exercises, 
(b) candidates performed the exercises while being ob- 
served by assessors, and (c) an integration or debriefing 
session was held with the assessors. 

Prior to the center itself, a PDI staff member spent one 
day explaining the general procedures and training asses- 
sors on how to conduct exercises, observe candidates' 
performance, and evaluate them. This training session 
began with a brief introduction to the background and 
general concept of the assessment center technique.^Then 
the PDI staff member reviewed the content of each exer- 
cise and describe^d briefly how candidates might be ex- 
pected to react based on the reactions of candidates 
participating in the pretests of the exercises. 

For the role-play exercises, assessors studied the vid- 
eotapes.made earlier with PDI staff members in the roles 
to be assumed by assessors and candidates. Assessors 
were instructed to attend closely to the * 'assessor's" 
performance and also to take notes on the ''candidate's" 
performance. After viewing the tapes, assessors indi- 
vidually rated the "candidate's" performance on the 
appropriate assessment dimensions. The PDI staff 
member then reviewed their ratings and emphasized the 
necessity of basing ratings and evaluations on obserrved 
behaviors — on what the assessor saw and heard a candi- 
date do. Assessors practiced making behavioral observa- 
tions of "candidates" performance in the videotapes and 
rating them accordingly. 

The pilot assessment centers were held either in hotel 
rooms or in ^'^cilities provided by the host police depart- 
ment. Each center basically required a conference room 
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where the group discussion exercises could be held and 
three rooms for the role-play interview simulations. 

The time required for a)nducting the pilot centers 
varied according to the function for which candidates 
were being assessed. Patrol Officer and Detective Cen- 



ters were each scheduled to run 1 day; Sergeant Centers 
ran IV^ days; and Intermediate Commander Centers, 2 
days. Assessors* and candidates' schedules for the pilot 
centers are presented In Tables 68 through 76. 



Table 68 

Schedule for Assessors anu Carulidates in the Pilot Patrol Officer Center 



Time 



Activity 



8:00 a.m.— 8:30 a.m. 

8:30 a.m.— !0:30 a.m.. 
10:30 a.m.— 11:30 a.m. 
11:30 a.m.— 12:00 noon 

12:00 noon— IXX) p.m. 

1:00 p.m.— 2KX) p.m. 
2:00 p.m.— 3:00 p.m. 
3:00 p.m. — 4:00 p.m. 
4:00 p.m.—-4:30 p.m. 
4:30 p.m.— 5KX) p.m. 



Orientation 
Micro-Training 
Domestics 
Traffic Stop 

Lunch 

Background Interview 
Professional Practices 
Frightened Woman 
Hotel Call 
Precinct Desk 



Table 69 



Schedule for Assessor 1 in the Pilot Detective Center 



Time 


Activily 


8:00 a.m.— 8:30 a.m. 


Orientation 


8:30 a.m.— 8:35 a.m. 


Crime Scene (A): Instruclions 


8:35 a.m.— 8:45 a.m. 


Crime Scene (A): Examine 


8:45 a.m. — 8:55 a.m. 


Mr. Adams (A): Interview 


8:55 a.m.— 9:30 a.m. 


Report Writing and Rating (on A) 


9:30 a.m.— 9:35 a.m. 


Crime Scene (B): Instructions 


9:35 a.m. — 9:45 a.m. 


Crime Scene (B): Examine 


9:45 a.m.— 9:55 a.m. 


Mr. Adams (B): Interview 


9:55 a.m.— 10:30 a.m. 


Report Wriling and Rating (on B) 


10:30 a.m.— 10:35 a.m. 


Crime Scene (C): Instructions 


10:35 a.m.— 10:45 a.m. 


Crime Scene (Q: Examine 


10:45 a.m.— 10:55 a.m. 


Mr. Adams (C): Interview 


10:55 a.m.— 11:30 a.m. 


Report Writing and Raiing (on C) 


11:30 a.m.— 12:15 p.m. 


Free Time 


12:15 p.m.— 1:15 p.m. 


Lunch 


1:15 p.m.— 2:15 p.m. 


Free Time 


2:15 p.m.— 3:15 p-m. 


Background Interview (C) 


3:15 p.m.— 3:45 p ni. 


Report of Backgtound Interview 


3:45 p.m. — 4:45 p.m. 


Case Planning 


4:45 p.m.— 5:00 p.m. 


Debriefing 



91 

70 

o 

ERIC 



Table 70 



Schedule for Assessor II in the Pilot Detective Center 



Time Activity 



8KX) a.m.— 8:30 a.m. 


Orientation 






8:30 a.m.— 9:30 a.m. 


Free Time 






9:30 a.m.— 9:45 a.m. 


Mr. 


Fisher 


(A): 


Instructions 


9:45 a.m. — 10:00 a.m. 


Mr. 


Fisher 


(A): 


Interview 


lO^X) a.m.— 10:15 a.m. 


Mr. 


Fisher 


(A): 


Rating on Interview 


10:15 a.m.— 10:30 a.m. 


Mr. 


Fisher 


(A): 


Rating on Mr. Fisher Report 


10:30 a.m.— 10:45 a.m. 


Mr. 


Fisher 


(B): 


Instructions 


10:45 a.m.— II ^X) a.m. 


Mr. 


Fisher 


(B): 


Interview 


11:00 a.m.— 11:15 a.m. 


Mr. 


Fisher 


(B): 


Rating on Interview 


ll:15a.m.— Il:30a.m. 


Mr. 


Fisher 


(B): 


Rating on Mr. Fisher Report 


11:30 a.m.— 11:45 a.m. 


Mr. 


Fisher 


(Q: 


Instructions 


11:45 a.m.— 12:00 noon 


Mr. 


Fisher 


(C): 


Interview 


12:00 noon— 12:15 p.m. 


Mr. 


Fisher 


(C): 


Rating on Interview 


12:15 p.m.— 12:30 p.m. 


Mr. 


Fisher 


(C): 


Rating on Mr. Fisher Report 


12:30 p.m.— 1:15 p.m. 


Lunch 







1:15 p.m. — 3:15 p.m. Analyze Written Cases (C) 

3:15 p.m. — 3:45 p.m. Analyze Written Cases (A) 

3:45 p.m.- 4:45 p.m. Case Planning 

4:45 p.m.— 5:00 p.m. Debriefing 



Table 71 

Schedule for Assessor III in the Pilot Detective Center 



Time 


Activity 


8K)0 a.m.— 8:30 a.m. 


Orientation 


8:30 a.m.— 9:30 a.m. 


Background Interview (B) 


_?.'30 a.m.— I0:l5.a.m. 


Report & Rating from Background Interview (B) 


16:15 a.m.— 11:15 a.m. 


Background Interview (A) 


11:15 a.m.— Il':45 a.m. 


Report & Rating from Background Interview (A) 


11:45 a.m.— 12:15 p.m. > 


D.A. (with admin.) (A) 


12:15 p.m. — 1:15 p.m. 


Lunch 


1:15 p.m. — 1:45 p.m. \ \ ' 


D.A. (B) 


1:45 p.m. — 2:15 p.m. v 


p.A. (C) 


.2:15 p.m. — 3:45 p.m. :i' 


Report Writing and Rating 


3:45 p.m. — 4:45 p.m. ' . • 


Case Planning 


4:45 p.m.— 5:00 p.m. 


Debriefing 
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Table 72 



Schedule for Candidate A in the Pilot Detective Center 



Time Activity 



8:00 a.m.— 8:30 a.m. 


Orientation 


8:30 a.m. — 8:35 a.m. 


Crime Scene: Instructions 


8:35 a.m.— 8:45 a.m. 


Crime Scene: Examine 


8:45 a.m.— 8:55 a.m. 


Mr. Adams: Interview 


8:55 a.m.— 9:20 a.m. 


Crime Scene: Report 


9:20 a.m.— 9:30 a.m. 


Crime Scene: Next Steps 


9:30 a.m.— 9:45 a.m. 


Mr. Fisher: Prepare 


9:45 a.m.— 10:00 a.m. 


Mr. Fisher: Interview 


10:00 a.m.— 10:15 a.m. 


Mr. Fisher: Report 


10:15 a.m.— 11:15 a.m. 


Background Intei^iew 


11:15 a.m.— 11:45 a.m. 


Free Time 


11:45 a.m.— 12:15 p.m. 


D.A. 


12:15 p.m.— 1:15 p.m. 


Lunch 


1:15 p.m. — 3:15 p.m. 


Written Cases 


3:15 p.m.— 3:45 p.m. 


Free Time 


3:45 p.m. — 4:45 p.m. 


Case Planning 


4:45 p.m.— 5:00 p.m. 


Debriefing 



Table 73 

Schedule for Candidate B in the Pilot Detective Center 



Time Activity 



800 a.m.— 8:30 a.m. 


Orientation 


8:30 a.m.— 9:30 a.m. 


Background Interview 


9:30 a.m.— 9:35 a.m. 


Crime Scene: Instruction'* 


9:35 a.m.— 9:45 a.m. 


Crime Scene: Examine 


9:45 a.m.— 9:55 a.m. 


Mr. Adams: Interview 


9:55 a.m.— 10:20 a.m. 


Crime Scene: Report 


10:20 a.m.— 10:30 a.m. 


Crime Scene: Next Steps 


10:30 a.m.— 10:45 a.ni. 


Mr. Fisher: Prepare 


10:45 a.m.— 11:00 a.m. 


Mr. Fisher: Interview 


11:00 a.m.— 11:15 a.m. 


Mr. Fisher: Report 


11:15 a.m.— 12:15 p.m. 


Free Time 


12:15 p.m.— 1:15 p.m. 


Lunch 


1:15 p.m.— 1:45 p.m. 


D.A. 


1:45 p.m. — 3:45 p.m. 


Wrinen Cases 


3:45 p.m. — 4:45 p.m. 


Case Planning 


4:45 p.m.— 5:00 p.m. 


Debriefing 
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Schedule for Candidate C in the Pilot Detective Center 



Time 


Activity 


8.-00 a.m.— 8:30 a.m. 


Orientation 


8:30 a.m.~-10:30 a.m. 


Written Cases 


10:30 a.m.— 10:35 a.m. 


Crime Scene: Instructions 


10:35 a.m.— 10:45 a.m. 


Crime Scene: Examine 


10:45 a.m. — 10:55 a.m. 


Mr. Adams: Interview 


10:55 a.m. — 11:20 a.m. 


Crime Scene: Report 


1 1:20 a.m. — 11:30 a.m. 


Crime Scene: Next Steps 


1 1*V> a.m. — 11:45 a.m. 


Mr. Fisher: Prepare 


1 1 4S a m ._ 12*00 nnnn 


Mr. Fisher: Interview 


12KX) noon— 12:15 p.m. 


Mr. Fisher: Report 


12:15 p.m.— 1:15 p.m. 


Lunch 


1:15 p.m. — 1:45 p.m. 


Free Time 


1:45 p.m. — 2:15 p.m. 


D.A. 


2:15 p.m. — 3:15 p.m. 


Background Interview 


3:15 p.m. — 3:45 p.m. 


Free Time 


3:45 p.m. — 4:45 p.m. 


Case Planning 


4:45 p.m.— 5:00 p.m. 


Debriefing 



Tablh 75 

Schedule for Assessors and Candidates in the Sergeant Center 



Time ^ Activity 



DAY I 




8KX) a.m.— 8:30 a.m. 


Orientation 


8:30 a.m.— lOKX) a.m. 


In-basket 


lOKX) a.m.— 10:30 a.m. 


In-basket Interview 


10:30 a.m.— 10:45 a.m. 


Coffee Break 


10:45 a.m.— 11:15 aim. 


Prepare for Ryan Interview 


11:15 a.m.— 11:45 a.m. 


Ryan Interview 


li:45 a.m.— 12KX) noon 


Ryan Report 


12:00 noon — 1:00 p.m. _ . 


Lunch 


1:00 p.m.— 3:00 p.m. 


Background Interview 


3HX) p.m.— 5KX) p.m. 


Preparation for Training Exercise 


DAY II 




8KX) a.m.— 8:15 a.m. 


Prepare for Kimple Interview 


8:15 a.m.— 8:45 a.m. 


Kimple Interview 


8:45 a.m.— 9:45 a.m. 


Supervisory Style Discussion 


9:45 a.m.— lOKX) aim. 


Coffee Break 


10:C0 a.m.— 10:30 a.m. 


Training Presentation 


10:30 a.m.— 11:30 a.m. 


Training Discussion 


11:30 a.m.— 12KX) noon 


Debriefing 
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Table 76 



Schedtile for Assessors and Candidates in the Intermediate Commander Center 



Time Activity 



DAY 1 






8:00 a.m.— 


8:30 a.m. 


•■' 

Orientation 


8:30 a.m.— 


10:30 a.m. 


In^basket 


10:30 a.m.— 


12:30 p.m. 


Background Interview 


12:30 p.m.-- 


i:15 p.m. 


Lunch 


1: i5 p.m. — 


l:4.*5 p.m. 


Prepare for Estes Interview 


1:^5 p.m.— 


2:15 p.m. 


Estes Interview 


2:1 p.m.— 


' 5:00 p.m. 


Prepare for Precinct Reorganization Exercise 


DAT n 






8.-00 .>.m.— 


8:30 a.m. 


Precinct Reorganization Exercise: Staff meeting led by Candidate A 






with Candidates B and C as subordinates 


8:30 a.m.— 


■ 9.-00 a.m. 


Precinct Reorganization Exercise: Staff meeting led by Candidate 






B with Candidates A and C as subordinates 


9:00 a.m.— 


• 9:30 a.m. 


Precinct Reorganization Exercise: Staff meeting led by Candidate 






C with Candidates A and B as subordinates 


9:30 a.m.— 


•10:00 a.m. 


Prepare for Simpson Interview 


10:00 a.m.— 


10:30 a.m. 


Simpson Interview 


10:30 a.m.— 


li:30 a.m. 


Prepare for Training Presentations to Recruit Class 


11:30 cm.— 


12:15 p.m. 


Training Presentations to Recruit Class 


12:15 p.m;— 


- 1:00 p.m. 


Lunch 


1:00 p.m.- 


- 1:45 p.m. 


Field Command Exercise 


1:45 p.m.— 


- 2:45 p.m. 


Prepare for Precinct Commander Group Discussion 


2:45 p.m.- 


- 3:45 p.m. 


Precinct Commander Group Discussion 


3:45 p.m.— 


- 4:15 p.m. 


Write Press Release for Precinct Commander Group Discussion 


4:15 p.m.— 


- 5K)0 p.m. 


Debriefing 



Schedules for the Patrol Officer, Sergeant, and Inter- 
mediate Commander Centers were relatively simple be- 
cause all three assessors and all three candidates in each 
were conducting or performing the same exercises at the 
same time. For example, in the Sergeant Center, from 
8:30 to 10:00, all three candidates completed the In- 
basket Exercise and from 11:00 to 11:45 Assessor I 
role-played Officer Ryan for one candidate while Asses- 
sor II did the same for the second candidate and Assessor 
III for the third candidate. 

Schedules for the Detective Center, however, were 
more complicated. Because only one crime scene was set 
up (for the Adamr Case exerci^os) and because only one 
candidate at a tiir.e could complete the Crime Scene 
Exercise, it was necessary to stagger the schedules. To 
facilitate scheduling, one assessor did the Mr. Adams 
role-play with all three candidates, another did all the 
Mr. Fisher role-play interviews, and :he third did all the 
District Attorney role-play interviews. 

The first item scheduled in all the pilot centers was a 
brief orientation session with candidates and assessors. 



The PDI staff member responsible for the overall ad- 
ministration of each center explained that the center was 
a pilot test being done as part of a research project funded 
by LEAA, introduced the assessors, described briefly the 
background of the assessment center technique, and 
explained in general terms the procedures and schedules 
for the center.. Candidates were assured that assessors* 
observations and reports of their performance would be 
regarded as privileged and confidential information and 
that how they perfoimed during the center would in no 
way help or hinder their careers. Also, they were told not 
to expect feedback from assessors on their performance. 

At the end of each center, if time remained, assessors 
and candidates discussed their reactions to the assess- 
ment center in general and to specific exercises. Candi- 
dates provided several suggestions for improving exer- 
cise instructions and revising exercise content for in- 
creased realism. 

After candidates were dismissed, assessors completed 
their reports and performance ratings for the various 
exercises. Following the Sergeant and Intermediate 
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Commander Centers, thorough integration sessions were 
conducted during which assessors discussed their obser- 
vations of candidates' performance in the individual 
exercises and reached consensus on overall ratings. 
These integration sessions lasted approximately 2 hours 
per candidate. Finally, the PDI staff member administer- 
ing the center discussed the center procedures and exer- 
cise content with assessors^nd elicited suggestions for 
improving the exercise format, administrative proce- 
dures for conducting the center, instructions provided to 
assessors for each exercise, rating and leportiRg proce- 
dures, and assessor training. 

Formal integration sessions were not held following 
the Patrol Officer and Detective Centers. We felt that 
when the assessment renters become implemented and 
operational, so many candidates would be tested in these 
two lower-level centers that the cost of conducting integ- 
ration sessions for Patrol Officer and Detective candi- 
dates would become prohibitive. The two upper-level 
centers, however, would likely have relatively fewer 
ciandidates. Moreover, the increased importance attached 
to correct promotional decisions for Sergeant and Inter- 
mediate Commander candidates more readily justifies the 
cost of thorough integration sessions following assess- 
ment centers for these two functions. After assessors 
completed their ratings in the Patrol Officer arid Detec- 
tive Centers, a PDI staff member briefly reviewed asses- 
sors' ratings and then discussed the center, exercises, 
and administrative procedures with assessors. 

In summary, we conducted eight pilot assessment cen- 
ters, tv,'o for each of the police functions under study, by 
carrying out the steps listed below: 

• Videotape recordings of all role-play exercises were 
made with experienced PDI staff members in the 
roles of "assessor" and /'candidate" to standaidize 
the role sets for assessors and to help train assessors 
in observing and evaluating candidates' perform- 
ance. 

• Arrangements were made with police departments 
i*^ four cities — Chattanooga, Tennessee; Portland, 
Oregon; Washington, D. C; and Minneapolis, 

* Minnesota— to conduct pilot centers with the coop- 
eration of their police officers. 

• Six team? of assessors were trained to conduct exer- 
cises, observe candirlates, and evaluate their per- 
formance. Each team consisted of a police official 
at the level of captain or above, a local 

■ psychologist, and a local citizen active in.sonw 
form of community or socid service work. Two 
teams werc^traiiMsd for Ihterme:^'iate^ C 
exercisesr^two for Sergeant exercises, and two for 
both Patrol Officer and Detective exercises. In all, 
:; : , ;18 assessors were trained. • 



• Three ''candidates" were tested in each pilot 
center. Candidates were either applicants for, or 
newly promoted incumbents of, positions in the 
police function represented in the assessment center 
exercises. In all, 24 candidates participated in the 
pilot centers. 

• At the ertd of the Intermediate Commander and 
Sergeant Centers, integration sessions were held 
during which assessors pooled observations of can- 
didates', performance and arrived at consensual 
judgment of candidates' effectiveness on the as- 
sessment dimensions. 

• At the end of all the pilot centers, assessors werc 
asked for their suggestions for improving the center 
procedures, exercise content, and as^ssor training 
procedures. 

We were gratified with the general success of these 
pilot centers. It was encouraging that even with minimal 
training, assessors seemed able to make sound, be- 
havioral observations of candidates' performance, form 
considered evaluatipns of candidates' effectiveness along 
the assessment dimensions backed by their behavioral 
observations, and arrive at consensual judgments on the 
relative overall levels of effectiveness shown by candi- 
dates. In addition, suggestions offered by both candi- 
dates and assessors were very helpful and to a large 
degree werc incorporated into the final revisions of the 
content of the simulations and the total assessment center 
process. 

F. Preparation of Assessors' Manuals 

Based on reactions and suggestions from persons 
trained to serve as assessors In the pilot assessment 
centers, PDI staff members prepared four comprehensive 
assessor's manuals, one for each of the four police 
functions for which we developed simulation exercises. 
(These assessor's manuals arc included in Appendix J of 
this report.) The manuals contain complete deifinitibns 
for the assessment dimensions tapped by the simulations; 
detailed instructions for assessors on how to cohcluct 
exercises, observe candidates, and evaluate their perfor- . 
mance; sample copies of all written instructions and 
materials for candidates; and sample copies of; ail report 
and rating forms to be completed by assessors jtfter each 
exercise. Tue manuals* were designed to ibe' used 'by; ; 
persons serving as assessors >yhen; police i assesisment 
centers be jome ppcrdticrial. For conyehiericej pageis are^ 
color-coded according to whether they are explanations ' : 
and instructions for assessors, instructions ;ind^ot^ ^ S 
written materials to be i^sed by r ciahdidatesv^br J rating 
forms to be completed by: assesisbrs: ; ^ A I 1'^* ; ^ ^ 

m White pages contain; explanations arid 
for assesisors. For each exercise; they irtolude^ brfef;^;^^ 



summary of the exercise; a list of the performance 
dimensions tapped by the exercise; instructions for 
setting up and administering the exercise; and in- 
structions for role-play exercises, guidelines, and 
information to be used by assessors in acting out 
their roles. 

• Blue pages are copies of all written materials to be 
handed out to candidates in each exercise. They 
include candidates* written instructions and 
background information, answer and rating forms 
to be completed by candidates, and other written 
materials to be processed by candidates during the 
exercise. ■■ ^, 

# Pink pages are copies of rating forms to be com- 
pleted by assessors after each exercise. 

G. Recommendations for Implementing 
Police Assessment Centers 

Police assessment centers similar to the ones we con- 
ducted as pilot tests can be developed for any of the four 
police functions by selecting various combinations of 
exercises and simulations. Exercises should be chosen 
according to whether they tap assessment dimensions of 
greatest interest. For instance, in a center for Detective 
candidates, if the dimension ''Interrogating Suspects** is 
regarded as highly important, the ''Adams Case: Fisher 
Interview*' which has been specially designed tc tap that 
dimension should be included among the set of simula- 
tions. Similarly, if "Appearing in Court** is seen as 
important, the "Adams Case: District Attorney Inter- 
view*' should be included. On the other hand, if "Ap- 
pearing in Court** is a relatively unimportant dimension, 
this exercise cun be excluded. The point is that assess- 
ment centers for any given application can be tailor-made 
to emphasize assessment dimensions of greatest concern 
in a particular police department by including exercises 
that tap those dimensions and excluding exercises that do 
not. Tables 63 through 66 summarize what assessment 
dimensions are tapped by each exercise in the catalogue 
of exercises and simulations and can be used as guides 
when selecting exercises for a tailor-made police assess- 
ment center. 

The duration of an assessment center — the amount of 
time required to test a candidate in all exercises included 
in the center— will depend largely on how many exer- 
cises are included and the ratio olf number of assessors to 
number of candidates. As a rule of thumb, assessors* 
time seems rnost efficiently utilized when ah assessment 
center is staffed with three assessors observing a group of 
six candidates. This ratio of one assessor for every two 
candidates is prevalent in many assessment centers. 

We recommend that each team of assessors include 
one police official at the level of captain or above in the 



police department wishing to select or promote candi- 
dates, one psychologist with training and experience in 
personnel selection and placement, and one local citizen 
active in some aspect of social or community service 
work. This combination of backgrounds and professional 
skills among assessors should help assure a fair and 
balanced assessment of police candidates. 

Exercises in an assessment center should be scheduled 
such that candidates are observed and evaluated by differ- 
ent assessors in different exercises. By the end of the 
center, each candidate should be observed and evaluated 
by all three assessors, each assessor having observed a 
candidate in different exercises. This helps control for 
any bias on the part of an assessor whose evaluations of a 
particular candidate will be compared to those made by 
other assessors on the same candidate. 

Persons serving as assessors will require intensive and 
thorough training which should include the following 
steps: 

• Study and become thoroughly acquainted with the 
definitions of assessment dimensions to be meas- 
ured during the assessment center. 

Review the content and procedures of all exercises 
included in the center as described in the Assessor*s 
Manual. 

• Observe role-play exercises as portrayed on vid- 
eotaped "standards" or by experienced persons act- 
ing the roles live. 

• Practice role-play exercises and become familiar 
with the standardized role sets to be assumed by 
assessors. 

• Practice conducting background interviews. 

• Practice recording behavioral observations of can- 
didates* performance and making evaluative ratings 
of performance backed by behavioral observations. 

• Observe experienced assessors as they conduct an 
actual assessment center, carry out role-play exer- 
cises and background interviews, make behavioral 
observations of candidates, and rate their effective- 
ness. 

Such training for assessors will probably require 2 
or 3 days plus the time required to observe an actual 
assessment center being conducted by experienced as- 
sessors. , ^ ■ ' V \ , V- ■ _ 

After an assessment center, assessors should pool their 
observations of candidates* performance and discuss 
candidates* overall effectiveness in the assessment di- 
mensions. At least for the lntermediate Commander and 
Sergeant Centers, these integration sessions should be 
structured to cover thoroughly all the important informa- 
tion learned about each candidiate during :the center. 
Assessors should discuss each btlier's obseiyatipn^ 
ratings for a candidate and try to reach consensus on how 



effective the candidate was on each dimension. This 
process would require 1 or 2 hours per candidate. 

For the detective and patrol officer centers, integra- 
tion sessions should include at least a general discussion 
of candidates' relative effectiveness as shown by their 
assessment center performance and a final ranking of all 
candidates participating in the center according to their 
overall effectiveness. This mini-integration discussion 
would last a total of approximately 2 or 3 hours. 

Once all assessors' reports and ratings on candidates' ' 
performances have been completed and after the integra- 
tion sessions are held, a summary report on the perfor- 
mance of each candidate should be prepared, either by 



the assessor who did the Background Interview with the 
candidate or by the administrative coordinator of the 
assessment center. This summary report should contain 
an abbreviated version of the candidate's personal his- 
tory, job background, and career aspirations as revealed 
in the Background Interview; a brief description of how 
effectively the candidate performed on each assessment 
dimension; and a statement of ihc candidate's overall 
effectiveness and potential in comparison to other candi- 
dates. The report should be a true representation of the 
observations and ratings made by assessors during the 
individual exercises and should reflect their consensus 
evaluation formed during the integration session. 
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CHAPTER IV. OPERATIONAL USE OF POLICE CAREER INDEX 
AND REGIONAL ASSESSMENT CENTERS FOR SELECTION AND 
CAREER GUIDANCE OF POUCE OFFICERS 



Chapters 11 and 111 have described the development 
and validation of POLICE CAREER INDEX inventories 
and the development and pilot te^s^mg of assessment 
center job simulations for each of four police functions. 
These materials are now ready and available for opera- 
tional use by local departments to help them in making 
selection, training, promotion, job transfer, and career 
counseling decisions for police candidates and/or experi- 
enced police officers working in their departments. 

Figure 7 shows how the POLICE CAREER INDEX 
Inventories can be used in concert with Regional Police 
Officer Assessment Centers* to provide information to 
local departments for use in carrying out the above per- 
sonnel decision practices. The various stages shown in 
Figure 7 are described briefly below (The numbers on the 
boxes shown in Figure 7 refer to the stages discussed in 
the following:) 

1 . A local department seeking qualified candidates for 
vacancies would announce the availability of such 
positions and designate a date for administration of 
the POLICE CAREER INDEX (PCI) Biographical 
and Personal Information Inventory. 

2. As candidates appear, the local department would 
carry out some form of preliminary screening, such 
as brief interviews, reference checks, etc., to de- 
velop a roster of candidates to be admitted to the 
PCI Inventory administration session. Sufficient 



^General procedures involved in scoring and inieipreiing the various 
predictor scales of the three inventories of the POUCE CAREER 
INDEX arc described on pages 50-55 of ais^)ter n. General pioce- 
duxes ncoessaiy for setting up Regional Police Assessntent Centeis are 
described on pages 76-77 of Chapter ID. Essentially, implementa- 
tion of such regional centers requires that a cadre of persons (including 
police officers at level of Captain or above, psychologists, and civic 
minded citizens) be trained to be available to serve as staff members of 
the centers. Regional centers are necessary because smaller depart- 
ments would have neither the resources nor the numbers of candidates 
necessary to warrant developing their own centers. Large departments, • 
however, may well consider the feasibility of establishing their own 
centers (as detailed in Chapter 3) and making the assessment service ' 
available on a fee basis to smaller departments. 



numbers of PCI booklets and answer sheets would 
be obtained; and, on the appointed day, all qual- 
ified candidates would complete the PCI Inventory. 

3. Completed answer sheets would be forwarded to a 
centralized computer scoring service for scoring 
and automatic interpretation. At that time, the local 
department would also indicate the types of predic- 
tor scale scores desired for each candidate. Usually 
a department reviewing inexperienced candidates 
would probably request scoring for only the patrol 
officer predictor scales, although early guidance 
and training of a newly hired trainee could perhaps 
profit by obtaining information relevant to the other 
police functions as well. 

Occasionally, a department might wish to 
evaluate an experienced police officer from some 
other department who might be under considera- 
tion for a supervisory or command job. At such 
times, the department would administer the ap- 
propriate PCI Situational Judgment Inventory 
(Sergeant or Middle Command) in addition to the 
PCI Biographical and Personal Information Inven- 
tory and request scoring on the appropriate keys. 

The scoring service would carry out the scoring 
and return interpretative profiles (similar to those 
shown as Figures 3, 4, 5, and 6 in Chapter II) to the 
local department within 2 days. 

4. The PCI results would then be used in conjunction 
with additional departmental screening methods 
(such as physical examination, panel interview, 
etc.) to form an overall ranking of candidates. 

5. The overall ranking of candidates would, tor most 
departments, probably lead directly to the accep- ^ 
tance of the highest ranking persons to enter police 
training. 

' Some departments might, however, seek further^ 
information on some of the candidates. These can- 
didates would be asked to attend a 1 -day Reg- 
ional Patrol Officer or Detective . Assessment 
Center. This option would, of course, invo'ive con- 
siderably greater cost to the department. But in 



78 



99 



O o 

< 3 



CO .5 



^ 8 *e3 

sill 



c 

C 60.2 

c r: 

S « g 
-HE 

-g c o 

O cd u 



2 §2 



Q 
< 

< 
y 

2 



Z 

o 

Q 

< 

o 



o cd 

3.i 





u 


c 


Cd 






c o 






C 




Cd 




U 



PU 

<i. 

> 

in 3 
^ Ji . 

Z 
UJ 



M tU X 



&0 



C/3 "2 



Cd D. 



U 




H-1 
Z « 

S 2 

UJ 

< c 
pu E 



21. 



^ ^ !§ 

Ei2 o CO 




D. O 

< 



u <5 

3 C 
O O 



> 



3 
6 



6^ 



6 



UJ 
UJ 

S w 

UJ Z > o 

2 ^2 



aj Co 

E 
E 

_o 



c 
c 



00 



UJ 

o 



100 



79 



some instances, the richness of the behavioral in- 
formation might warrant obtaining such informa- 
tion. 

6. Each candidate finally accepted should then be 
interviewed in a ''feedback** session where the 
wealth of information obtained about her or him 
during the selection. process would be discussed, 
with particular emphasis placed upon implications 
of the information for special training needs, areas 
of strength and weakness, possible career oppor- 
tunities, etc. 

7. Upon graduation from police academy training, 
officers would typically be assigned directly to 
police jobs either as patrol officers or as detectives. 
Again, some departments might seek further in- 
formation about an officer early in his or her career 
by asking him or her to attend a regional police 
assessment center. More typically, however, the 
job performance of young officers would be 
evaluated periodically according to the depart- 
ment\s existing personnel practices. 

8. At some point in a young officer's developing 
career, the department might administer various 
inventories of the POLICE CAREER INDEX and 
request scoring on predictive scales bearing on 
detective, sergeant, and middle command jobs. 
Such information then would be used in conjunc- 
tion with the accumulating knowledge of the 
officer's job performance to build a preliminary 
roster of '*above average potential" officers for 
later promotional consideration when advancement 
opportunities develop. 

9. At some stage (or, perhaps on several occasions) in 
an officer's career, the department would ask that 
he or she attend a regional police assessment cent- 
er. There, the officer's potential would be 
evaluated according to the simulations and be- 
havioral observation methods described in Chapter 
ni. If PCI information were not available on a 
candidate at the time of atteT>ding the regional 



center, the information would be obtained at that 
time as part of the total assessment center proce- 
dure. 

10. Information about the officer's performance at the 
regional center would then be transmitted to ~ 
appropriate persons in the department. It is desir- 
able that the same information be given, with 
departmental approval, to the officer so that opti- 
mal use would be made of it in developing jointly 
agreed upon career recommendations, guidelines 
for further personal development, and basic be- 
havioral information to be combined with all 
other information in developing a firm evaluation 
of his or her potential for serving effectively in the 
whole range of police positions available in the 
department. 

The two '"instruments" developed in this research 
program provide a total personnel evaluation system for 
decision making at all levels of police work, ranging 
from entry to the force to career guidance for individual 
officers and the development of increasingly accurate 
estimates of potential as those officers gaifi' maturity and 
experience in their jobs. As has been mentioned, the 
central and most important feature of these two coordi- 
nate'' assessment methods (the POLICE CAREER 
INDEX and the job-f6cused Police Officer assessment 
simulation exercises) is their grounding, at every stage of 
development, in behaviorally explicit patterns defined by 
the most critical features of police officer job perfor- 
mance. Thus, the POLICE CAREER INDEX scales are 
directly interpretable according to expected patterns of 
police job performance instead of being in the form of 
the usual traits measured by psychological tests. And, 
the assessment simulations have beien shown to elicit 
successfully^ exactly those behavior patterns discovered 
to be critical to successful performance in different 
police jobs. The total evaluation system shown in Figure 
7 provides a base, therefore, for gathering and ac- 
cumulating information over time that is increasingly: 
relevant and accurate for making personnel decisions 
about persons and jobs in police departments. 
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JOB PERFORMANCE DESCRIPTION BOOKLET* 
for 

PRECINCT PATROLMEN 



Feel free to page through this booklet before the rating session 
begins. The directions are more conpl icated than the usual rating 
form — however, once you get the idea, the ratings are easy to do 
and wi 1 1 go quicl<1y . 

PLEASE DO NOT START THE RATINGS UNTIL ALL DIRECTIONS HAVE BEEN GIVEN. 



JOB PERFORMAfJCE DESCRIPTION SCALES 
FOR PRECINCT PATROLMEN 

Measuring job performance has always been an important issue for both 
supervisors and subordinates. Supervisors want to know how well a man 
Is performing his job so that they can make decisions about him such as 
sal^ty Increases, promotions, etc. And all men, whether supervisors or 
subordinates, want to knew how well they are doing their own job so that 
they can pay more attention to the things they do poorly and thereby 
Improve. 

However, measuring job performance is a difficult thing to do. Though 
we all speak English, we quite often have a different understanding of 
what some common words mean, such as good, poor, average, etc. Because 
we differ in what we mean by these words, we often cannot cjgree on 
whether a person's job performance is "good,** ''average," or "poor." 
Numbers don't help either, because people still have trouble agreeing 
on what they mean in terms of job performance. Another problem in 
measuring job performance is that most people find it hard to make up 
their niinds about what the major characteristics are of what they want 
to measure. 

Let's say you were going to paint a room brown tor a friend. You show him 
the color of paint you have and he says that the color you have is "a lot 
less brown" than the color he wants. So you change the combination of 
colors and he says that the color you hcve is "not quite as brown" as 
the one he had in mind. You change the combination of colors that 
make up brown and he says, "That color is a little less brown than I 
wanted." It is clear that what your friend means by "a lot less brown," 
"not quite as brown," "a little too brown,'* etc. is not the same as what 
you mean by "a lot less brown, '^~-!'not quite as brown," etc. This is an 
example of the problem people have with measuring things using words that 
are not closely related to the thing they are measuring. In this case the 
color brown. 

If your friend had told you that the paint was too shiny, you would have 
known he was talking about something Ouher than the color of the paint, 
but what if he took the shininess of the paint into account and didn't 
telli you? This is an example of having different ideas of what Is in- 
volver? in measuring brownness. 

Well, you got smart and decided that you would make up a whole series 
of brown paint chips according to different combinations of colors and 
arrange them so that your friend could look at them and pick the color 
he expected his room to be painted in. Of course, not every possible 
shade of brown v;as included in the colors you showed him, but the examples 
you had mapped out fonned a scale of brown. 
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We have tried to develop job performance rating scales for precinct 
patrolmen that consist of abojt the same thirig. Each scale is a list 
of possible examples of behavior. The examples form an outline of 
what is involved in doing one aspect of the Job of a patrolman. The 
examples also serve as guideposts or trail markers along the scale, 
marking off more and more effective performance. 

We developed 11 different rating scales plus an overall performance 
scale for the job of precinct patrolman, based on information provided 
by patrolmen ar\f} sergeants in a major metropolitan city. The names of 
these scales a e: 



A. Crime Prevention 

B. Using Force Appropriately 

C. Traffic Maintenance and Control 

D. Maintaining Public Safety and Giving First Aid 

E. Investigating, Detecting, and Following up on CrimlnaV Activity 

F. Report Writing 

G. Integrity and Professional Fthics 

H. Dealing Constructively with the Public 

I. Handling Domestic Disputes 

J . Commi tment, Dedi cation , Conscientiousness 

K. Teamwork 

L. Overall Job Performance 

Instructions : In the booklet accompanying these c'irections you will find 
12 Job categories representing performance dimensions 'hich are important 
for the job success of patrolmen. Each job category ha^ immediately below 
it a definition of the category and seven or eight performr-»nce examples 
gathered from policemen in a number of cities. Each performance example 
"anchors" the portion of the scale opposite it. That is, on the job 
category, "Crime Prevention," the performance example which begins, "The 
officer went to every 2A-hour gas station . . ." represents the kind of 
behavior or performance which should be rated at 8 or 9. Thus, the 
performance examples should help to define further the job category and 
should provide, "benchmarks" for defining points on the nine-point scales. 

In edditiorv to the job categories booklet containing the 12 categories, 
their definitions, and the performance examples, we have provided you with 
a rating worksheet for each Job categorywith the names of the patrolmen 
you will be rating on the left side of the worksheets. You will then 
use these worksheets to record the ratings you assign to your subordinates 
When you are ready to begin the rating task, you should first read over 
the definition and the performance examples for Job Category A, "Crime 
Prevention." Get the content of this job category firmly in mind. Now 
consider the typical performance within this category r>f your first sub- 
ordinate ratee. Compare his typical performance wi th ihe performance 
represented by the eight "benchmarks." Assign this man the rating which 
best typifies his level of performance in the Crime Prevention area com- 
pared with the example anchors. Record that rating opposite his name on 
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the worksheet entitled Crime Prevention. Then, go on to the next sub- 
ordinate and rate him on the same Job category. When ycu have finished 
rating all of your subordinates on Crime Prevention, turn to the next 
category (Job Category B, ''Using Force Appropriately") and proceed the 
same way you did for the first category. Follow the same procedures 
for the other 11 categories as well. 

Things to^guard against : Several sources of error can contribute to 
Inaccuracies in your ratings. Mentioning them briefly may help you to . 
guard against making them. Here are suggest'ons for overcoming them: 

1) Consider each performance category separately from all the rest. 
An almost universal error in ratings is called HALO EI^ROR. It 
occurs when the rater gives about the same ratings to a person 

on all aspects of performance. Usually this error occurs because 
a rater has not really taken enough time to get clearly in mind 
what each separate category of performance refers to. Remember 
we are asking you to describe or rate each of your subordinates 
on 12 categories of performance. As you consider each of the 
persons you are rating try to avoid getting into the habit of 
giving about the same rating to him on each job category. Con- 
sider each category separately from all others. Be sure to rate 
all your subordinates on each category before going on to the 
next category. 

2) Consider each subordinate's performance over time and r-ot on 
just one or two occasions. Another type of error occurs when 
a rater is influenced by just some single event or some recent 
occurrence. As you consider each subordinate's performance, 
think back over all the time you have known him and try to avoid 
being influenced by just one or two events. Base your ratings 
on all your observations of him and not just a few. 

3) Avoid being misled by such things as appearance, education, 

f ami ly background, and other personal characteristics. Another 
comnon error in rating is called STEREOTYPE ERROR. It occurs 
when a rater allows himself to be influenced by other things 
than what the person has actually done on the job. In con- 
si-^ering each subordinate's job performance, try to ignore every- 
thing else you may know about that.person. Give your rating 
based strictly on what the individual has done on the Job. 

k) Avoid using your own definitions for the various job categories. 
A common reason for inaccurate ratings is because raters have 
different definitions of the job categories. Terms such as 
Crime Prevention, Maintaining Publ ic Safety, and Dealing Con- 
structively with the Public, etc. can have different meanings 
for different raters. This is why It is so very Important for 
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you to read the definitions and performance examples carefully 
for these job categories. Avoid any previous impressions of 
what these things have meant to you. Base your ratings on the 
definitions which are provided in the rating booklet you have 
received. 

Remember, these ratings will be used solely for the purpose of validating 
the experimental battery of tests given earlier to those persons you are 
rating. Neither performance evaluations nor test scores will be shown to 
any mfimber of the police department. Thus^ ycu should fael free to be 
open and honest in comrileting these ratings. Thank you very much for your 
cooperation. 
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CRIME PREVENTION 



Job Category A 

Knov^ledge of effective crime prevention, such as silent alarms, 
security fences, lighting and random patrol; educating citizens 
to aid in deterring criminal activity or in aiding apprehension 
of suspects; maintaining security in keeping relevant informa- 
tion from potential criminals; being aware^of trends in criminal 
activity; keeping an eye on potential or known criminals in the 
area. 
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The officer went to every late night gas station in his area to 
slcrt the attendants about a group of hold-up n>2n who had been 
hitting gas stations. He left a description of the men, a phone 
number to call and detailed instructions on what to do if the men 
were spotted. Because of his actions the hold-up men were 
apprehended. 

When eight burglaries had occurred in a small area, the officer 
told a citizen that he would tell them how to help if they wished. 
The citizen organized a coffee party where the officer's tips on 
what to do led to the arrest of six young men. 

An officer, after checking apartment house parking lots for car 
prowlers, would make a note of any apartment that didn't have 
good lighting and then tell the caretaker during the day. 

The officer advised a bar owner who had been burglarized to 
wire a bell to the back door so a bartender who lived above 
the bar could tell vihen there was a break-in. 

After there had been a rash of burglaries, the officer began 
spending more time patrolling the area they occurred in. 

While on his night beat, an officer observed a business with one 
of the windows open. Finding no evidence of a break-in, he failed 
to report the open window to the owner the next day. 

A burglar who was being transported to Jailosked how the officer 
had known he had broken in. The officer then explained all about 
silent alarms— how they worked, how to spot them, etc.— educating 
him for his next job. 

While on patrol an officer takes his coffee and lunch breaks at 
the same time and same place every night. He also patrols his 
teat In the same pattern every night. 
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USING FORCE APPROPRIATELY 



Job Category B 

Keeping one's "cooP* under pressure or personal abuse; being 
able to judge and to utilize the correct amount of force to 
resolve an incident promptly ond effectively; avoiding acts 
that might be seen as brutal or sadistic; retaining composure 
when confronted with hostility and provocation. 



A deskman calmly convinced a man who was pointing a rifle at 
him to hand it over rather than shooting the man when he had 
the chance. 

:ln a fight with a traffic violator, the violator knocked one 
officer down, took his revolver, and shot six shots at the 
officer's partner, hi ttihg him four times. The wounded officer 
pulled his revolver and drew a bead on the violator, who then 
threw the empty gun down and raised his hands. The wounded off i' 
cer did not fire, but instead kept the violator covered until 
he was in custody. 

An officer stopped a car for a traffic violation and the driver 
assaulted the officer with obscenities and verbal abuse. The 
officer wrote the tag and calmly explained why the man got 
the tag and how he could handle it, still amid a barrage of 
obscenities. 

The officer grabbed the arm of a girl attacking her boyfriend 
with an ice pick, narrowly saving him. The officer was then 
assaulted by her, and had his shirt ripped by the ice pick 
before he struck her i.n the head with his gun to subdue her. 

The officer waited for two young men who had been rowdy and 
noisy in a restaurant to come back to their car to pick them 
up. He took them to a dark area several blocks from their car, 
kicked them in the ass, and told them to walk back to their 
car. He also said that they should stay out of the area, 
because their kind weren't needed. 

While taking a very hostile and belligerent man to jail, the 
officer purposely threw him against the wall. 

The officer slapped a man who was pestering a bartender to 
sell him a drink after hours. 

A man stopped after being chased at high speed. Even though the 
situation was in hand, an officer from a second squad which 
pulled up began beating the man. 
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TRAFFIC MAINTENANCE AND CONTROL 



Job Category C 

Concern for and effect I ve actions for maintaining mptorlzed and 
pedestrian traffic safety; knowing traffic ordinances ;''^xer- 
clslng caution In apprehending speeders and other offenders; 
responding quickly to accidents and taking proper actions to 
preserve life and protect property; protecting the accident 
s^ene. ' 



After an officer became aware that a dangerous intersection had no 
traffic control devices and that a high hedge was obstructing the 
view, he took it upon himself to contact the traffic engineers 
to have signs posted and the owner of the hedge to have it cut. 

While tagging a driver for speeding in a school zone, the 
officer explained how unpredictable children were when playing 
and how much damage a car can do to a pedestrian. 

An officer on routine patrol observed an emergency vehicle 
attempting to go through an intersection and immed lately took 
measures to stop traffic and control th:: situation. 

The officer tagged and towed a parked car which he found 
covered with snow, though it hadn't snowed for five days. 

Investigating an accident, an officer used his squad car 
to block a street at the bottom of a hill. A car coming 
down the hill was unable to stop and hit the squad. 

Observing a driver traveling at high speeds down a residential 
area late one night, an officer decided not to ticket the 
Individual because the street was clear, but to warn him. 
[Even when the driver became impatient with being stopped, 
the officer gave only a warning.} 

While on patrol, the squad car was almost involved in an 
accident with a car which turned right in front of it* The 
officer disregarded the partner's suggestion to give a tag 
and said, "No, I'll just chew them out." 

While directing rush hour traffic from the middle of a very 
busy intersection, the officer began a needless conversation 
with a friend. He stopped directing traffic and , stood wi th 
his friend in the middle of the street obstructing the flow 
and seriously endangering himself and his friend. 
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MAINTAINING PUBLIC SAFETY AND GIVING FIRST AID 



Job Category D 



Concern for public safety; knowing and using the proper pro- 
cedures for dealing with hazardous or emergency situations; 
evacuating and restricting activities in dangerous areas; 
giving quick and effective first aid v/hen indicated. 

• ^' . ^ 

^ At a propane gas tank leak, the officer requested cars to block 
specific intersections. He then shut down two nearby companies 
and began. evacuating the area, all before receiving orders from 
his supervisor, 

} 

While watching a parade, an old man collapsed. An officer 
rushed up, pushed the crowd back, gave mouth-to-mouth resus- 



Arrivlng at a house with two burning fire bombs on the front 
porch, the officer evacuated the house, contacted the fire de- 
partment, and extinguished the flames with d?^*t. 

Responding to a call about a burning car, an officer, noticing 
a fire near the gas tank, evacuated the area of bystanders and 
contacted the fire department. 

In response to a suicide attempt where a girl had slashed her 
wrists, the officer administered proper first, aid to stop the 
bleeding. 

At a bomb threat to a business, the officer evacuated the 
building, but did not evacuate adjacent buildings. 

An officer saw that the sidewalk next to a building that was 
being wrecked was not blocked off and that people might be 
hurt by debris, but he did nothing about It. 

At an auto accident a victim complained that he was injured, 
though there were no signs of any injury. The officer told 
the person that he was faking and then refused to call an 
ambulance. 
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INVESTIGATING, DETECTING, AND FOLLOWING. UP ON CRIMINAL ACTIVITY 
Job Category E 

Being fully informed about aM wanted felons; being alert to 
unusual circumstances or out-of-the-ordi nary situations; pro- 
tecting the crime scene to maintain the integrity of evidence; 
attenti veness to detail; effective questioning of witnesses; 
verifying both suspects' and wi tnesses ' answers; following up 
on all clues cr leads. 

9 An officer was called to a domestic involving a man with a .38 
caliber revolver and two companions trying to get an ADC check. ^ 
Six hours latn>r, when' an armad robbery took place in another 
district by three men with a .38, he immediately provided detec- 
3 tives with names of suspects and a car description, leading to 
arrests and recovery of the loot. 

After finding footprints leading up to a wall of a warehouse, 
7 but no prints leading away, an officer called for a dog and a 
key for the warehouse. A burglar who had scaled the wall and 
entered through a ventil-'^tor shaft was found inside. 

6 At the scene of a man with a gun tall , the officer found a gun 
which he handled carefully to preserve any fingerprints. 

'An officer requested a listing on a car parked in front of a 
5 house occupied by people who were suspected of associating with 
burglars. Since the plates listed to another car, it was 
towed away. 

*» The officer was given a knife that appeared to have blood on 
It by a man who had found it laying in his yard. The officer 
put the knife in the glove compartment and forgot about it. 

.5 Early one morning an officer noticed a young man standing near 
a used car lot. When the officer asked him what he was doing, 
he said he was waiting for his dad to pick him up. Ti.e officer 
left and the next morning several car parts were reported 
■2 missing from the used car lot. 

At the scene of a burglary where many TV sets were taken, the 
officer was told by a neighbor that he had observed a truck at 
the scene earlier in the evening. The off icer fai led to get 
the neighbor's name and did not follow up the information. 
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REPORT WRITING 



Job Category F 

Knowing and using the proper style or mode for reporting or 
communicating information; providing complete reports of one's 
actions; specifying all details which may aid in reconstructing 
the incident; uising the correct grammar and language in reports, 



The officer's report of a robbery of a person where a suspect 
was apprehended contained not only a standard account of the 
crime, but details of the weather and lightihg conditions at the 
scene and a field sketch of the crime scene. 

The officer's resume contained the names of all witnesses he 
questioned, their occupation, residence, phone' number, and 
reason for being in the area. 

An officer helped two other officers write a report of a 
felony arrest so that it contained all necessary information 
and was acceptable to the county attorney. 

On a report form for a burglary of a dwelling, the officer 
filled in all of the spaces properly, but the body of the 
report was brief and he failed to explain some minor details. 
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An officer's offense report did not mention the type of 
residence burglarized. 

An officer's report contained many incomplete sentences or 
fragments, such as "held suspect while partner opened case 
he was carrying." 

An officer was called to a house burglary, investigated, 
and filed a report. The next day, he was requested by the 
Detective Division to return to the scene and redo his •incom- 
plete report. 

An. officer wrote an incomplete and messy report of a serious 
crime. He was told to redo the report, but instead he simply 
filled in the missing information. (The report was again 
returned and the officer was told to retype it.) 
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INTEGRITY AND PROFESSIONAL ETHICS 



Job Category 6 

Avoiding opportunities to use one's badge, uniform, or authority 
for personal gain; refusing bribes, inventorying all evidence; 
presenting evidence accurately and completely; avoiding situa- 
tions which might compromise one^s honesty. 



The officer gave a businessman he knew a ride home, because the man^, 
was drunk. The next day the officer received an envelope containing 
$'200 from the businessman. The officer returned the money and 
explained that he took the man home because he was a friend and 
expected nothing for It. 

A man offered to pay the officer if he wouldn't enforce prostitu- 
tion laws so tightly In his area.. The officer refused, sent a 
memo to the Morals Division and observed the man even closer 
In the future. 

An officer who was having financial problems was offered a $100 
bribe by a drunk driver, but he Immediately refused the money 
and added attempted bribery to the charges. 

The officer gave a ride to a man who had left his house as a 
result of a domestic. At his destination, the man offered the 
officer some money for his troubles, but the officer declined. 

After arresting two men drinking Illegally and confiscating 
their bottle, the officer refused the money offers of "wines" 
along the street for the liquor. 
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On the way home from work, an officer would stop at a drive-In 
that fed uni formed .of fleers for nothing and pick up dinner for 
his family. 

Two officers walked into a bar and one officer asked for a 
Christmas bottle for each. When his partner said, "Put mine 
back, I don't want It," this officer took both bottles. 

* 

Answering a call to a D.O.A., an officer told the bystanders in 
the apartment building to go back to their rooms, that he would 
handle everything. His partner asked why he was searching the 
apartment, and the officer replied, "You never know what you can 
find, especially money." 



Job Category H 



DEALING CONSTRUCTIVELY WITH THE^PUBLIC 



Courtesy and understanding; helping citizens in matters that' 
may not be strictly police business; maintaining and improving 
the police department's image in the eyes of the public;' know- 
ing about and using other agencies for referral of citizens 
who have special problems. 



The officer made a service call to a destitute family. He called 
the proper authorities to obtain assistance for them and bought a 
tree and presents to make their Christmas happier. 

Answering a call in which a blind man had been robbed of his 
grocery money, the officer went to a nearby church to collect 
food coupons and then took the blind man to the store and 
assisted him in. buying groceries. 

The officer had an elderly woman who had lost her house keys 
sit in the squad, out of the cold, while he gained entry. 
After she was inside the officer replaced the storm window 
he had removed. 

Because the bartender admitted having served the man too 
much liquor, the officer didn't arrest the man who was 
slumped over the bar, but instead walked htm home. 

A girl's boyfriend was abusive toward an ambulance attendant; 
who spoke in a loud voice to the hysterical girl in an attempt 
to get through to her. An officer called the boyfriend aside 
and told him In no uncertain terms that he was wrong and to 
stop interfering. 

A man flagged an officer down and asked if he could get a 
jump start since his car battery was dead. The officer said 
he wasn't allowed to and drove off. 

The deskman was listening to a man's questions about a traffic 
accident when the phone rang. He just picked up the phone 
saying, "The forms are on the table," but he didn't answer the 
man's questions. 

A depressed alcoholic committed suicide by jumping out of a 
hotel room after a minister left the room to get the man's 
bag. The investigating officer said, "When you left the room 
to go down to the car, did the guy tell you he'd meet you?" 
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HANDLING DOMESTIC DISPUTES 



Job Category I , 

Holding back and using restraint in working with arguments and 
fights between husbands and wives, boyfriends and girlfriends, 
or other domestic combatants; exercising caiJtion; mediating 
between parties while maintaining impartiality; referring citi- 
zens to appropriate agencies for further help. 



9 When the officer arrived at the scene of a domestic, he found that 

the husband had assaulted his wife but that she didn't want him 
arrested. She wanted to leave with her small children, so the 
officer helped the woman dress her children while he kept the hus- 
band In a separate room. While the officer drove them to her 
parents' home, he advised her of the various agencies that could 
assist her with her marital problems. 

The husband and wife knew the officer by name and his first 
action at that domestic call was to get them in separate rooms, 
ask each what their problems were, and how he could help. The 
wife wanted the husband to go to bed or leave, since he had 
been drinking. The officer presented him with these alternatives 
and advised him to go to bed, which he did, 

-"7 

, On th6 third call to a husband/wife domestic, the officer 

realized the wife was using the officer's presence to belittle 
the husband. The officer took her aside and told her to seek 
help for her problems, but that the officer would nol How her 
to misuse his authority. 

In orde' to arrest a man without a fight, the officer at a domes- 
tic explained that by law he had to arrest the man, that he would 
call more officers if need be, and that the man might get hurt 
if he put up a fight . 
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At a domestic, the wife made a "citizen's arrest*' of her hus- 
band. The son sided with his father, and the officer had a 
difficult struggle to subdue and jai 1 him. 

At a domesliic, the officer advised the husband, who was drunk, to 
leave when his wife refused to sign a complaint. The domestic was 
settled, because the husband drove away, but he left under the 
influence of alcohol • 

--3 

When the officer arrived at a domestic^ the wife started to 
leave, but the officer called her back and the husband/wife 
domestic began again. 

2 

The officer took a gun away from a woman in a domestic, but 
gave It back to her before her husband had left, so that she 
had It reloaded as her husband .was leaving. 



COMMITMENT, DEDICATION, AND' CONSCIENTIOUSNESS 



Job Category J 

Exerting maximum effort at all times; responding to all calls; 
constantly updating and improving one's skiils; being on time; 
readiness to provide police services at all times, both on and 
off duty; readiness to respond to needs at all times, both on 
and off duty; conducting oneself properly when off duty. 



An off-duty police officer and his wife pulled into a gas sta- 
tion just after it had been held up. The officer told hiis wife 
to call the police, then gave chase on foot, apprehending one 
suspect. 

An officer observed a person jump from a bridge Into the HIssis 
sippi River. He jumped into the river and pulled the person 
to safety. 

An officer recent I y--a=ssigned as deskman at the precinct 
received no instruct ions- on what the job involved, so he read 
the job description and was able to handle all duties. 

An officer occas lona Dy ass igned to a certain beat noticed 
juveniles hanging around a vacated building. The officer 
passed this information on to the men who were permanently 
assigned to the iairea. 

An off-duty who was informed of a potentially danQerous sit^ua- 
tlon; i.e., children digging into the side of a steep bank, 
failed to make note of it and did not remember to report It 
for several days. 

The officer was in a cafe drinking coffee, even though he 
had told the dispatcher he was still at an accident. 

After being informed at roll call every day two weeks prior 
to the date that officers were to change to winter uniforms, 
an officer came to work in his summer uniform. 

The officer was tipped off to a burglary, but got there too 
late because he took care of some personal business first. 
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TEAMWORK 



Job Category K . 

Having a good "feeT* for what one's partner's actions are going 
to be without asking; backing him up an(i keeping his safety in 
mind at all times; keeping him informed; willingness to risk 
one's own safety to assure his protection; cooperating with 
other divisions or departments; assisting other lav/ enforcement 
agencies such as the FBI or State's Attorney, 



When the officer saw the criminal he and his partner had been 
tailing was about to shoot his partner, he yelled t^he criminal's 
name, which fouled his shot, saving the partner's life. 

While two officers were closing in on a wanted criminal, the 
officer realized that his partner had not seen the gun the 
criminal had drawn. The officer yelled and alerted his 
partner. 

While searching some bars for a robbery suspect, one officer 
would stand In front of the bar while his partner would go 
Inside and look for the suspect. 

When the officer received his days-off slip for the month, he 
called his partners and arranged the days off so that the days 
off were acceptable to all. 

At roll call an officer was given memos concerning his squad's 
work In a district. The officer put the Information In his 
pocket, failed to tell his partner what It concerned, and handled 
the situation by himself. Thus, his partner was unable to answer 
his supervisor's questions regarding the handHjng of the 
instructions. 

When asked to assist In arresting a drunk, the officer simply 
walked away, even though the drunk was being obviously 
troublesome to his fellow officer. 

An officer remained In a squad car "apparently frozen" even 
though his partner got out of the squad, attempted to break up 
the fight, got involved In It, and was threatened by the 
c rowd . 
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OVERALL JOB PERFORMANCE 



Job Category L 



g "Hark In this range'if you consider your subordinate 

^superior or outstanding. 
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Consider here the overall performance of a subordinate you are rating. 
The following should enter into your rating:, how well, does he do th^ 
total job; how valuable is he to the department; how much does he con- 
tribute to the department's effectiveness. 
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'Mark in this range if you consider your subordinate 
^satisfactory but not outstanding. 



- - 2 
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^Mark in this range if you have any reservations 
^. about considering your subordinate satisfactory. 
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JOB PERFORMANCE DESCRIPTION BOOKLET* 
f o r 

INVESTIGATIVE PERSONNEL 



* Feel free to page through this booklet before the rat ing sess ion 
begins. The directions are more complicated than the usual rating 
form — however, once you get the idea, the ratings are easy to do 
and will go quickly. 

PLEASE DO NOT START THE RATINGS UNTIL ALL DIRECTIONS HAVE BEEN GIVEN. 
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JOB PERFORMANCE DESCRIPTIOH SCALES 
INVESTIGATIVE PERSONNEL 

Measuring job performance has always been an important issue for both 
supervisors and subordinates. Supervisors want to know how well a man 
IS performing his job so that they can decisions about him such as 

salary increases, promotions, etc. And all men, whether supervisors or 
subordinates, want to know how well they are doing their own job so that 
they can pay more attention to the things they do poorly and thereby 
improve. 

However, measuring job performance is a difficult thing to do. Though 
we all speak linglish, we quite often have a different understanding of 
what some common words mean, such as good, poor, average, etc. Because 
we differ in what we mean by these words, we often cannot agree on 
whether a person's job performance is *'good,'* "average,** or *'poor.** 
Numbers don*t help either, because people still have trouble agreeing 
on what they mean in terms of job performance. Another problem in 
measuring job performance is that most people find it hard to make up 
their minds about what the n>ajor characteristics are of what they want 
to measure. 

Let's say you were going to paint a room brown for a friend. You show 
him the shade of paint you have and he says that the shade you have is 
••a lot less brown" than the shade he wants. So you change the combina- 
tion of colors and he says that the shade you have Is **not qylte as 
brown*' as the one he had in mind. You change the combination of colors 
that make up brown and he says, '*That shade 5s a little less brown than 
I wanted," It is clear that what your friend means by **a lot less 
brown,'* "not quite as brown," "a little too brown," etc. is not the same 
as what you mean by "a lot less brown,** **not quite as brown,** etc. This 
is an example of th«.t problem people have with measuring things using 
words that are not closely related to the thing they are measuring, in 
this case the color brown. 

If your friend had told you that the paint was too shiny, you would have 
known he was talking about something other than the shade of the paint, 
but what If he took the shininess of the paint into account and didn*t 
tell you? This is an example of having different ideas of what is in- 
volved, in measuring brownness. 

Well, you got smart and decided that you would m^ke up ^ whole series 
of brown paint chips according to different combinations of colors and 
arrange them so that your friend could look at them and pick the shade 
he expected his room to be painted in. Of course, not every possible 
shade of brown was included in the colors you showed him, but the 
examples you had mapped out formed a scale of brown. 
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We have tried to develop job performance rating scales for precinct 
patrolmen that consist of about the same thing. Each scale Is a !lst 
of possible examples of behavior. The examples form an outline of 
what Is involved In doing one aspect of the job of a patrolman. The 
examples also serve as guldeposts or trail markers along the scale, 
marking off more and more effective performance. 

We developed 12 different rating scales plus an overall performance 
scale for the job of investigator, based on Information provided by 
investigators and detectives in a major metropolitan city. The names 
of these scales are: 

A. Investigating the Scene of a Crime ^ 

B. Arrest, Search, and Seizure 

C. Interrogating Suspects ^ 

D. Investigating a Case 

E. Developing and Utilizing Informants 

F. Report Writing and Paperwork 

G. Appearing in Court 

H. Publ ic Relations 

I. Dealing with Juveniles 

J. Cooperating with Other Officers and Divisions 

K. Conscientiousness and Dedication 

L. Integrity and Honesty 

M. Overall Job Performance 

Instructions ; In the booklet accompanying these directions you will find 
13 job categories representing performance dimensions which are important 
for the job success of investigators. Each job category has immediately 
below it a definition of the category and seven or eight performance 
examples gathered from policemen in a number of cities. Each performance 
example '^anchors'* the portion of the scale opposite It. That is, on the 
job category, ^'Investigating uhe Scene of a Crime," the {performance 
example which begins, "At the scene of a robbery where one suspect . . 
represents the kind of behavior or performance which should be rated at 
8 or 9. Thus, the performance examples should help to define further the 
job category and should provide "bench^narks" for defining points on the 
nine-point scales. 

In addition to the job categories booklet containing the 13 categories, 
their definitions, and the performance examples, we have provided you 
with a rating worksheet for each job category with the names of the 
investigators you will be rating on the left side of the worksheets. 
You will then use these worksheets to record the ratings you assign to 
your subordinates. When you are ready to begin the rating task, you 
should first read over the definition and the performance examples for 
Job Category A, "Investigating the Scene of a Crime." Get the content 
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of this job category firmly in mind. Now consider the typical perfor- 
mance within this category of your first subordinate ratee. Compare 
his typical performance with the performance represented by the eight 
•'benchmarks/' Assign this man the rating which best typifies his level 
of perforcTiance in the area of "Investigating the Scene of a Crime" com- 
pared with the example anchors. Record that rating opposite his name 
on the worksheet. Then, go on to the next subordinate and rate him on 
the same job category. When you have finished rating all of your subor- 
dinates on the first category, turn to the next category (Job Category B, 
"Arrest, Search, and Seizure") and proceed the same way you did for the 
first category. Follow the same procedures' for the other 12 categories ^ 
as wel U 

Things to guard against ; Several sources of error can contribute to 
inaccuracies in your ratings. Mentioning them briefly may help you to 
guard against making them* Here are suggestions for overcoming them: 

1) Consider each performance category separately from all the rest, 
.An almost universal error in ratings is called HALO ERROR, It 

occurs when the rater gives about the same ratings to a person 
on all aspects of performance. Usually this error occurs because 
a rater has not really taken enough time to get clearly in mind 
what each separate category of performance refers to. Remember 
we are asking you to describe or rate each of your subordinates 
on 13 categories of performance. As you consider each of the 
persons you are rating try to avoidgetting into the habit of 
giving about the same rating to him on each job > category . Con- 
sider each category separately from all others. Be sure to 
rate all your subordinates on each category before going on to 
the next category, 

2) Consider each subordinate's performance over time and not on 
just one or two occasions. Another type of error occurs when 
a rater is influenced by just some single event or some recent 
occurrence. As you consider each subordinate's performance, 
think back over all the time you have known him and try to svold 
being influenced by just one or two events. Base your ratings 
on all your observations of him and not just a few, 

3) Avoid being misled by such things as appearance, education, 
family background, and other personal characteristics. Another 
common error in rating is called STEREOTYPE ERROR. It occurs 
when a rater allows himself to be influenced by other things 
than what the person has actually done on the job. In consid- 
ering each subordinate's job performance, try to ignore every- 
thing else you may know about that person. Give your rating 
based strictly on what the individual has done on the job. 
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k) Avoid using your own definitions for the various job categories. 
A convnon reason for Inaccurate ratings Is because raters have 
different definitions of the job categories. Terms such as 
•'Arrest, Search, cand SeUure," "Interrogating Suspects," and 
"Public Relations," etc.,. can have different meanings for dif- 
ferent raters. This Is why It Is so very important for you to 
read the definitions and performance examples carefully for 
these job categories. Avoid any previous Impressions of what 
these things have meant to you. Base your ratings on the 
definitions which are provided In the rating booklet you have 
received. 

Remember, these ratings will be used solely for the purpose of validating 
the experimental battery of tests given earlier to those persons you are 
rating. Neither performance evaluations nor test scores will be shown to 
any member of the police department. Thus, you should feel free to be 
open and honest In completing these ratings. Thank you very much for 
your cooperation. 
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INVESTIGATING THE SCENE OF A CRIME 



Job Category A 

Coordinating the information search at the scene of a crime; super- 
vising personnel at the scene; recognizing, collecting, preserving, 
and processing physical evidence; searching for and identifying wit 
nesses; determining the nature of the crime and evaluating possible 
charges against suspects. 
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At the scene of a robbery where one suspect was captured and 
the victim wounded,, a homicide investigator delegated specific 
areas of responsibility to each of the patrplmen and other 
investigators at* the scene. 

At the scene of a shooting, an investigator obtained informa- 
tion from the uniformed of ficers, -had pictures taken of the 
scene and followed a trail of the victim's blood, taking samples 
along the way. 

While conducting a search in -20* weather for a homicide sus- 
pect, an investigator discovered a footprint in the snow, 
covered the print, and assisted the Bureau of Identification 
in taking photos of the print. 

At the scene of a shooting in which a rifle was tised, the 
investigator searched the ground for spent casings. 

^ At a burglary scene, the investigator failed to have the 

photographer take a picture of the point of entry. 

* Called to the scene of a dwelling burglary Involving juvenile 

suspects, the investigator found a positively identifying finger- 
print on one article, but did not examine other items handled 
by the suspects and did not take plaster casts of footprints. 

^ During the investigation of a shooting scene, the investigator 

failed to segregate the witnesses, prior-to questioning and 
allowed people to enter the scene, thus contaminating evidence. 

2 

The Investigator called to the scene of a burglary of business 
did not make a written supplement to the original report, took 
no photographs, failed to inventory evidence, failed to search 
the immediate area of the crime, and did not note the business 
addresses of the witnesses. 
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ARREST, SEARCH^ AND SEIZURE 



Job Category B 

Making appropriate use of laws of arrest, search, and seizure; pre- 
paring search warrants; providing information for arrest warrants; 
using proper caution and force in arresting suspects and searching 
prisoners; advising suspects of their rights, conducting searches 
methodically; inventorying property. 



When the investigator spotted a wanted felon on the street, 
he called for assistance, kept the suspect in sight until it 
arrived, and then told the uniform officers where to station 
themselves during the arrest. 

Investigator found, seized and marked small pieces of wood 

found in the trunk of suspect's car. The wood chips were matched 

to drawers within a safe recovered at a later date. 

While executing a search warrant for narcotics in a dwelling, 
the investigator recorded the serial numbers of various 
appliances, stereos, etc. he found in the dwelling. He later 
checked NCIC and the property room to see if the items were 
stolen. 

The investigator obtained a search warrant prior to searching 
a suspect's car which was found near the scene of crime. 

Investigator made a legal search with a warrant and found a 
gun believed to be stolen, but left same. After checking 
records, he ascertained the gun to be stolen, went back, and 
found that the gun had been removed. 

While searching a house, the investigator did not account for 
the physical dimensions of the house and overlooked a hidden 
room concealed by a large cabinet. 

^ Because the arresting investigator had handcuffed a check forger 

with his hands in front and failed to search the man, the forger 
was able to throw away stolen checks he was carrying. 

An investigator picked up a murder suspect whose description had 
been broadcast, and took him to the scene for identification before 
searching him for weapons. 
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INTERROGATING SUSPECTS 



Job C«|egory C 

Planning and carrying out the Interrogation of specific suspects; 
keeping an open mind during Interrogation; recording confessions 
from suspects; confirming facts learned during Intc^rrogat Ion. 
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An Investigator was sent to another state to bring back a suspect 
wanted in Minneapolis. The suspect had been questioned by the ¥BI, 
local and state police to no avail. The investigator checked 
the man's background and found he had been a high school baseball 
star in Minneapolis. During the trip back, the investigator got 
the man to open up by using his old memories o£ baseball and 
Minneapolis as a bridge. 

When the investigator found that the burglary suspect he was 
interviewing was antagonistic toward police, he asked the 
reasons why, and then adopted a sympathetic manner. This led 
to the confession and recovery of stolen property. 

Two investigators tried to interview a suspect, but the 
suspect became belligerent and would not talk. One 
investigator left while the other continued to make small 
talk. Finally the investigator got the suspect to talk with 
him about the crime. 

The investigator began his interrogation of a burglary suspect 
by saying, "Let's talk a little bit about your background so 
I can get to know you." 

An investigator obtained a confession from a burglar suspect 
which closed the case, but he failed to find out what had 
been done with the stolen property. 

The investigator began talking about snowmobiles (an interest ^ 
he had in common with the suspect) in an interrogation of a^ 
robbery suspect. However, after an hour, the Investigator 
and the suspect were still talking about snowmobiles and 
hadn't gotten around to the robbery. 

After a long interrogation, a murder suspect dictated a state- 
ment. However, the investigator waited until the next day to have 
him sign the statement, at which time the suspect refused. 

Becatxse the evidence was insufficient for prosecution and an 
admission was needed, the officer told a burglary suspect that 
he was not advised of his constitutional rights because he, 
bad none. 
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INVESTIGATING A CASE 



Job Category D 

Gathering and evaluating supporting evidence for prosecuting a case; 
following up clues; finding and interviewing witnesses; taking state- 
ments from victims and witnesses; identifying suspects by conducting 
line-ups, showing mug shots, and comparing fingerprints. 



The investigator located some stolen property, but only a 
fraction of the total loss from a big burglary. The 
investigator observed the suspected burglar's activities 
for over a week until he led him to the remainder of the 
stolen propetty. 

After an elderly woman who had been swindled out of $500 
was unable to identify the suspects from mug shots, the 
investigator contacted cities in neighboring states and 
asked for photos and descriptions of confidence men. He 
then showed these new pictures to the woman. 

Checking on the license number of s car used in a burglary, 
the investigator found that the address and owner were non- 
existent. The investigator checked to see who the previous 
owner was and contacted him for information on the present 
owner. 

Even though the victim of a burglary had seen the suspects 
at a distance of 25 feet and was unsure of what they looked 
like the investigator showed the victim a lengthy series of 
mug shots. 

Because tWo hold-up suspects had worn ski masks during the 
crime, the investigator did not hold a line-up. 

An investigator charged two suspects arrested for stealing 
from parking meters with petty theft rather than felony 
theft of government funds. "-"X, 

An investigator did not check the ownership of a cat a robbery 
suspect was driving when arrested. 

Because the investigator did not like to go into the area a 
burglary had occurred in, he conducted his investigation over 
the telephone. 
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DEVELOPING AND UTILIZING INFORMANTS 

Job Category E 

Locating and developing informants; controlling and protecting them; 
gathering and evaluating information from informants. 



While testifying, the officer refiised to identify an inforunt 
whose information led to the arrest of a gang of burglars 
because he had promised the informant that he would not be 
identified. 

The investigator recovered stolen property for a shoddy 
character and used this to develop a friendship with the 
man which led to the man giving the investigator information 
about criminals he knew. 

An investigator worked at developing informants on a 24-'hour 
basis by encouraging criminal types he met to phone his home 
or office whenever they needed assistance. 

When a morals squad investigator broke up a "crap" game, he 
recognized one of che participants as an ex-con on parole. 
The investigator told the ex-con that if he provided the 
robbery division with information on a series of recent armed 
robberies, the investigator would not contact the man's parole 
officer. 

When interviewing an informant about a prospective burglary , 
the investigator did not ask the informant how he happened to 
know about the planned burglary or his reasons for 
cooperating with the police. 

An investigator in Morals arrested a prostitute and refused to 
trade her release for information on "bard" narcotics, even 
thoitgh he' knew the information was probably good. 

A morals investigator, while attempting to develop a woman as 
an informant, became intimately involved with her. 

While interviewing a suspect arrested based on information 
supplied by an informant, the investigator revealed to the 
suspect the identity of the informant. 



REPORT WRITING AND PAPERWORK 



Job Category F 

Reporting all necessary Information concisely; presenting Infor- 
mation in chronological sequence; using correct terminology in 
reports; writing memos and instructions for other investigators; 
keeping proper records and files* 



In deactibing a DOA, the investigator wrote ao cos^lete a 
report that when a question arose as to what kind of watch the 
auapect was wearing, the information was found in Che 
investigator's report • 

8 

On a lengthy case involving many investigators, this investi- 
gator summarized the individual reports, attached his summary 
to them and labeled it as a synopsis. 

1 

When the investigator filled out supplementary reports, he made 
a point of filling in all of the blanks and then double checking 
all reports on the case to make sure there were no discrepancies* 
6 ^ 

The investigator indicated on his reports the times witnesaea 
could be reached for follow-up ^urpoaea* 

5 

The investigator took complete notes at the scene. However, they 
included notes on matters which had no bearing on the crime. 

k . , , \ ■ 

The investigator takea notes on a case on small slips of paper 
which he keeps in no apparent order in a box on his desk. 

3. 

An officer *who made out an initial^ report in an assault case 
involving juveniles failed to get the ages, telephone numbers/ 
schools attended, etc. of the witnesses and auspects. 

2 ■ 

All ;.nve«tigator wrote a report on a homicide and in the report 
apc:Cified information as fact when in reality the facta were only 
asaumptiona. • 



APPEAR INQ IN COURT 



Job Category G " .. .a-^-- 

Preparing Information for testimony in court and giving testimony; 
reviewing reports; presenting information concisely and accurately 
when testifying; using proper language; working cooperatively with 
prosecuting attorney* 



In the trial of a child murderer* the officer on the witness 
stand did not exhibit his 'personal feelings against the 
defendant. 

While testifying In court » the Investigator did not volunteer 
Information and tried to answer questlo;^:s concisely. 

Prior to testifying In court on a case which Involved a great 
decl of physical evidence and a lengthy Interrogation of the 
suspect » the Investigator pulled the case from the file and 
reviewed it. 

An investigator brought his own report of a robbery and the 
witness reports with him when he went to testify in court. 

The officer makes a late appearance at a trlal» thereby 
inconveniencing others Involved. 

When the investigator was asked by the defense attorney how a 
murder suspect appeared when questioned^ he sald» "confused" $ 
when he actually meant to say "evasive and devious". 

During the trial of a burglary suspect » the investigator on the 
case gave conflicting and Inadequate testimony^ because he had 
not reviewed his reports. 

An officer lost his temper* swore at the judge* and stomped 
out of the court room after hearing a Judge's decision. 
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PUBLIC RELATIONS 



Job Category H 

Dealing constructively with the public; being courteous, under- 
standing, and professional in handling suspects, witnesses, 
victims, and the public In general; maintaining and Improving 
the department's image in the eyes of the public. 



t 



The newspaper printed a story about an investigator who had 
arranged with the Humane Society for a new dog for sobu 
children whose dog had been clubbed to death by a burglar. 

A burglary investigator alerted all of the victims of cases 
he was working on to the status of his' investigation and the 
results of any prosecution of suspects. 

The Investigator, a regular patron of a small grocery store, 
wa.s informed by the owner that several small .checks written 
by the same person had "bounced". The investigator contacted 
the man and convinced him to make his checks good. 



An investigator told a woman who reported that a gang of 
criminals were monitoring her by radio waves that he had 
arrested them on orders from the FCC and that the criminals 
would be in Jail for 20 years. 

When a burglary investigator found out that an attorney who 
wanted his clients released to his custody for the holidays 
had also told his clients to say nothing, he refused to 
release then. 

An Investigator showed up exactly at 6:00 p.m. , even though 
he had been told by the witness of a burglary that he didn't 
want to be interviewed u^tf.l later in the evening. 

The investigator told the mother of a child which had been 
molested, "As long as you live in this neighborhood, you'll have 
to expect such things." 

An investigator lost his cool and physicslly ejected a mentAlly 
retarded man who had come in to make a complaint. 
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DEALING WITH JUVENILES 



Job Category I 

Contacting parents; talking and lecturing to Juveniles In schools; 
deciding whether or not Juvenile offenders should be charged; set** 
ting up conferences with Juveniles^ parents and victims; referring 
Juveniles to proper agencies; following proper procedures when 
Interviewing and interrogating juveniles. 



9 

When a youth gets into trouble, the Juvenile officer tries to 
work out a solution by first talking with the parents and then 
setting up family counseling or getting help from Big Brothers* 
Big Sisters, Boys Club, etc. Only after everything else fails 
does he refer the youth to juvenile court. 

8 

The Juvenile officer got the pai;ents of some Juveniles to 
consent to have their boys clean a garage they had written 
obscene words on« 

7 

A Juvenile officer stationed in a school made up a full vail 
display in his office of narcotics posters, books, pamphlets* 
accessories, articles, etc. Students would come to view the 
display and he would talk with them about drugs. 

6 

A Juvenile officer calls former delinquents he has worked with 
to see how they are doing. 

^ Vfhen the investigator could not get a youth to admit to a series 
of garage burglaries in which the youth was the prime suspect* 
theTbiEficer called the youth's parents, told them his suspicions* 
and warned them to keep better, tabs on the boy* or he was going 
to get caught. 

A Juvenile officer told a group of youths that anyone who took 
drugs was a criminal and should be treated like one« 

3 

An investigator assigned a case of minor property damage due 
to Juveniles contacted the suspects and advised them to stop. 
However* he did not advise them to pay the victim for the damage* 
he did not contact the parents, and he did not contact the victim 
to advise him of the results of the investigation. 

2 

While standing in the playground after school* a fifth grader 
taunted and swore at a Juvenile officer. The officer then 
grabbed the youth and slapped him. 

I 



COOPERATING WITH OTHER OFFICERS AND DIVISIONS 



Job Category J 

Working cooperatively with other investigative divisions; keeping 
others Informed of matters concerning them; assisting other depart* 
ments and agencies such as sheriff or FBI. 



When the investigator learned that some men were planning a 
burglf.ry in an adjoining state, he put the men under sur\reillance 
and sent all of the information he had to the concerned police 
agencies in the adjoining state. 

8 

Having learned from an informant that a Juvenile was Implicated 
with an adult in four burglaries, the j^Ivenile investigator 
solicited the aid of, and cooperated with, a burglary investi* 
gator in obtaining a search warrant and investigating the case. 

7 

After uniformed officers made an arrest of a felony suspect, 
the investigator continued to give the officers complete 
details oii the progress of the investigation. 

6 

When a Juvenile officer determined a youth had burglarised a 
home and stolen a pistol along with. other property, he sent a 
description of the youth to the uniformed officers in the precinct 
with a request for a "pick-up". 

5 

A narcotics investigator obtained information on a possible 
burglary suspect. He checked the info out and solved the 
case without contacting the Burglary Division. 

The investigator ordered two uniformed officers to keep a 
certain house under surveillance and to report any activity. 
However 9 he neglected to explain the general purpose of the 
Investigation. 

3 

An investigator who was assigned a case involving the theft 
of Federal funds, refused To share information with the FBI, 
because he was afraid they would solve the case first. 

2 

An investigator did not share information concerning a possible 
robbery of a bar, even though he could have contacted f;he Robbery 
Division. He planted himself in the bar hoping he would appre* 
hend the suspects, because he wanted the glory of capturing 
them by himself. 
1 ... 



135 



CONSCIENTIOUSNESS AND DEDICATION 

Job Category K 

Exerting maxlmu-n effort at all times; attempting to do one's best 
on all casei; constantly updating and Improving one's skills; 
being intere^sted in all aspects of police work; working over-time 
willingly; providing pol ice service both on and off duty. 



The investigator reviewed a year old unsolved homicide -^mm€ 
which had not been assigned to him. He re-examined all the 
information and developed new leads which. resulted in 
solving the case. 

An investigator stayed many hours after quitting time to 
complete his preliminary .investigation of a robbery. 

When an investigator was transferred to a new division, 
he checked all the statutes applicable to his new Job, ~ 
checked books out of the library on the new job, and 
reviewed completed cases from the files to familiarize hia-^ . 
self with the new Job. 

An investigator was transferred from Robbery to Theft 
Division, but often receives information on robberies which 
he forwards to the Robbery Division. 

The investigator attended college part- time and would some- 
times read his text books at work when the load was light. 

Because of his physical condition, the overweight investigator 
did not chase a suspect seen running from the scene of a 
robbery. 

Because a case required a lot of leg work, the investigator 
stalled working on it until the shift changed and it was 
re-Maigned. 

An Investigator called in sick on a Monday even . though he 
wasn't, to try to avoid getting stuck with a heavy case load. 
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INTEGRITY AND HONESTY 



Job Category L 

Treating all cases equally, not using the badge for personal gain; 
not letting personal prejudices or biases influence one's profes- 
sional opinion; not accepting bribes or gratuities. 



An investigator was the first man on the scene of ah attempted 
safe Job. The burglar had left- in such a hurry that $1500 was 
still in the safe. The investigator did not touch the money, 
even though he could easily have taken it and blamed the 
burglars. 

Even though an investigator had the opportunity to shade the 
truth to **get** a suspect whom h.e hated, he would not do lt« 

A morals investigator was offered a $50 payoff each week if he 
would ignore a prostitute. The investigator took the bribe, 
and turned it in with a complete report to his supervisor. 

The investigator told a man who wanted to reward him for 
solving a robbery of his store to donate the money to the 
Policemen's Benevolent Fund if he wanted to reward him. 

An investigator spent more time and energy investigating 
a case in which his friend was the victim than he would 
have xisually spent. 

An investigator accepted a good deal on a car as a reward 
for solving a theft case involving a used car lot. 

An investigator who frequently checked a bar where 
prostitutes worked, mentioned to the bar owner the 
trouble he was having with his car. The place the owner 
sent him to to get his car repaired never sent the 
investigator a bill and he never checked beck to g^t one« 

After conducting a burglary investigation, the inve8.tigator 
(who was still on duty) offered to check the security of 
the victim's store; e.g., locks, lights, alarms, etc. for 
$150. 
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OVERALL JOB PERFORMANCE 



Job Category H 

Consider here the Overall performance of a subordinate you are rating. 
The following should enter Into your rating: how well does he do the 
total job; how valuable is he to the department; how mur.h does he con- 
tribute to the department's effectiveness. 



% , .. . 



8 ^ Mark in this range If you consider your subordinate 

^superior or outstanding. 



4- 7 



6 



I ^ Haric in this range if you consider your subordinate 

, satisfactory but not outstanding. 



-+3 N. 



■ 2 ^^T\f. in this range if you have any reservations 

^ about considering your subordinate satisfactory. 
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JOB PERFORMANCE DESCRIPTION BOOKLET* 
for 
SERGEANTS 



* Feel free to page through this booklet before the rating session 
begins. The directions are more complicated than the usual rating 
form — however, once you get the Idea, the ratings are easy to do 
and will go quickly. 

PLEASE 00 NOT START THE RATINGS UNTIL ALL DIRECTIONS HAVE BEEN GIVEN. 



JOB PERFORMANCE DESCRIPTION SCALES 



SERGEANTS 

Measuring job performance has always been an important issue for both 
supervisors and subordinates. Supervisors want to know how well a m^in 
is performing his job so that they can make decisions about him such as 
salary increases, promotions, etc. And all men, whether supervisors or 
subordinates, want to know how well they are doing their own job so that 
they can pay more attention to the things they do pooriy and thereby 
improve. 

However, measuring job performance is a difficult thing to do. Though 
we all speak English, we quite often have a different understanding of 
what some common words mean, such as good, poor, average, etc. Because 
we differ in what we mean by these words, we often cannot agree on. 
whether a person's job performance Is ''good," '"average," or "poor.** 
Numbers don't help either, because people still have trouble agreeing 
on what they mean in terms of job performance. Another problem in 
measuring job performance is that most people find it hard to make up 
their minds about what the major characteristics are of what they want 
to sr<easure. 

Let's say you were going to paint a room brown for a friend. You show 
him the shade of paint you have ^d he says that the shade you have is 

lot less brown" than the shade he wants. So you change the combina- 
tion of colors and he says that the shade you have is "not quite as 
brown" as the one he had in mind. You change the combination of colors 
that make up brown and he says, "That shade is a little less brown than 
i wanted." It is clear that what your friend means by "a lot less 
brown," "not quite as brown," "a little too brown," etc. is not the same 
as what you mean by "a lot less brown," "not quite as brown, '^ etc. This 
is an example of the problem people have with measuring things using 
words that are not closely related to the thing they are Pleasuring, in 
this case the color brown. 

If your friend had told you that the paint was too shiny, you would have 
known he was talking about something other than the shade of the paint, 
but what if he took the shininess of the paint into account and didn't 
tell you? This is an example of having di fferent -Ideas of what is in- 
volved in measuring brcwnness. 

Well, you got smart and decided that you would make up a whole series 
of brown paint chips according to different combinations of colors and 
arrange them so that your friend could look at them and pick the shade 
he expected his room to be painted in. Of course, not every possible 
shade of brown was included in the colors you showed him, but the 
examples you had mapped out formed a scale of brown. 
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Ve have tried to develop Job performance rating scales for sergeants 
that consist of about the same thing. Each scale is a list of possible 
examples of behavior. The examples form an outline of what is involved 
In doing one aspect of the job of a sergeant. The examples also serve 
as guideposts or trail markers along the scale, marking off more and 
more effective performance. 

We developed eight different rating scales plus an overall performance 
scale for the job of sergeant, based on information provided by sergeants 
and their supervisors in a major metropolitan city. The names of these 
scales are: 



A. Concern for Subordinates 

B. Scheduling, Coordination, Deployment, and Manpower A1 location 

C. Supervision 

D. Performing Administrative and Inspection Functions 

E. Decision Making and Initiative Where No Firm Guidelines Exist 

F. Training and Plannirrg 

G. - Integrity, Dedication, and Conscientiousness 

H. Dealing Effectively with the Public and Superiors 
{. Overall Job Performance 



Instructions ; In the booklet accompanying these directions you will find 
nine job categories representing performance dimensions which are important 
for the job success of investigators. Each job category has immediately 
below it a definition of the category and eight performance examples 
gathered from policemen in a number of cities. Each performance example 
''anchors'' the portion of the scale opposite it. That is, on the job 
category, "Concern for Subordinates" the performance example which begins, 
"A patrolman was scheduled for . . .** represents the kind of behavior or 
performance which should be rated at eight or nine. Thus, the performance 
examples should help to define further the job category and sh'ould provide 
••benchmarks" for defining points on the nine-point scales. 

In addition td the job categories booklet containing the nine categories, 
their definitions, and the performance examples, we have provided you 
with a rating worksheet for each job category with the names of the 
sergeants you will be rating on the left side of the worksheets. You will 
then use these worksheets to record the ratings you assign to your sub- 
ordinates. When you are ready to begin the rating task, you should first 
read over the definition and the performance examples for Job Category A, 
••Concern for Subordinates. •• Get the content of this job category firmly 
In mind. Now consider the typical performance within this category of your 
first subordinate ratee. Compare his typical performance wi th the per- 
formance represented by the eight ••benchmarks .•' Assign this man thie rating 
which best typifies his level of performance !n the area of 'Concern for 



EKLC 



141 



121 



3. 



Subordinates" compared with the example anchors. Record that rating 
opposite his name on the worksheet. Then, go on to the next subordinate 
and rate him on the same job category. When you have finished rating 
all of your subordinates on the first category, turn to the next category 
(Job Category B, "Scheduling, Coordination, Deployment, and Manpower 
A1 location'') and proceed the same way you did for the first category. 
Follow the same procedures for the other categories as welK 

Things to guard against ; Several sources of error can contribute to 
Inaccuracies in your ratings. Mentioning them briefly may help you to 
guard against making them. Here are suggestions for overcoming them: 

1) Consider each perfonjiance category separately from all the rest. 
An almost universal error in ratings Is called HALO. ERROR. It 
occurs when the rater gives about the same ratings to a person 

on all aspects of performance. Usually this error occurs because 
a rater has not really taken enough time to get clearly In mind 
what each separate category of performance refers to. Remember 
we are asking /ou to describe or rate each of your subordinates 
on nine categories of performance. As you consider each of the 
persons you are rating try to avoid getting Into the habit of 
giving about the same rating to him on each job category. Con- 
sider each category separately from all others. Be sure to rate 
all your subordinates on each category before going on to the 
next category. 

2) Consider each subordinate's performance over time and not on 
just one or two occasions. Another type of error occurs when 
a rater is influenced by just some sinigle event or some recent 
occurrence. As you consider each subordinate's performance, 
think back over all the time you have known him and try to avoid 
being influenced by just one or two events. Base your ratings 
on all your observations of him and not just a few. 

3) Avoid being mis]ed by such things as appearance, education, 
family background, and other personal characteristics. Another 
common error In rating Is called STEREOTYPE ERROR. It occurs 
when a rater allows himself to be influenced by other things 
than what the person has actually done on the job. In consid- 
ering each subordinate's job performance, try to Ignore every- 
thing else you may know about that person. Give your rating 
based strictly on what the Individual has done on the job. 

4) Avoid using your own definitions for the various job categories. 
A common reason for inaccurate ratings is because raters have 
different definitions of the job categories. Terms such as 
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"Supervision," 'Training and Planning," and "Concern for Sub- 
ordinates," etc., can have different meanings for different 
raters. This is why it is so very important for you to read 
the definitions and performance* examples carefully for these 
job categories. Avoid any previous impressions of what these 
things have meant to you. Base your ratings on the definitions 
which are provided in the rating booklet you have received 

Remember, these ratings will be used solely for the purpose of validating 
the experimental battery of tests given earlier to those persons you are 
rating. Neither performance evaluations nor test scores will be shown 
to any member of the police department. Thus, you should feel free to be 
open and honest in completing these ratings. Thank you very much for 
your cooperation. 
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CONCERN FOR SUBORDINATES 



Job Category A 



Showing concern for subordinates; being considerate; talcing personal 
interest in their problems; giving recognition when deserved; using 
human relations principles; filling in for subordinates who have 
special problems; being aware of subordinates' needs and feelings. 



A petrolman was scheduled for a vacation that would coincide 
with his wife's operation. When the operation was changed 
to a later date, the sergeant checked the work load and 
rescheduled his vacation to meet the change. 

The sergeant wrote a letter of commendation to an officer 
who had done an outstanding job of clearing a case. He also 
sent a copy to the superintendent and posted a copy on the 
squad room bulletin board. 

The sergeant told a man who showed up for roll call with a 
bad cough, sore throat, and riinny nose to go home, because 
as he said, "I would rather you stayed home for a couple of 
days with a cold than work and get even sicker." 

The sergeant told an officer who had come to him for some 
advice about personal problems that he (the sergeant) 
couldn't give him much help and maybe the officer should 
see a professional counselor. 

The sergeant talked to an officer who had been having clashes 
with the other men on the shift and learned that he was 
frustrated because he hadn't made promotion. The sergeant 
suggested that the officer be a little less aggressive in 
the future. 

Vhen two of the three men on a squad complained of a "person- 
ality conflict" with their new partner, the sergeant, without 
further inquiry, placed the new man on a beat. The sergeant 
also did not discuss the reason for the change with the new man. 

The sergeant told a patrolman who wanted to be excused two 
hours early from his tour to. begin a long vacation trip to 
check back later. When the officer checked bnck, the sergeant 
told him ^o check back again. The tour ended with the officer 
never having received a yes or no answer. 

When a patrolman had a personal problem and wanted to* go home 
early to clear up the situation, the sergeant yelled and 
ficreaoed and shouted obscenities at the patrolman in the 
presence of several other officers. 



SCHEDULING, COORDINATION, DEPLOYMENT, AMD MANPOWER ALLOCATION 



Job C«.t«gory B 

Matching manpower assignments with crime trends; assigning squads or 
unmarked cars to patrol certain areas; scheduling to take sick leave, 
vacation requests, and sh2ft changes into account; deploying men using 
superiors' guidel Ines; scheduling without playing favorites. 



When uniformed patrols were unable to do much about an 
increase in burglaries in a residential area, the sergeant 
rescheduled his men and had several men come to work in 
plainclothes and patrol in unmarked cars until they were 
able to apprehend the burglars. 

The sergeant scheduled his men 30 that a maximum nuisber were 
working on heavy "call load'' days (i.e., Fridays and Saturdays) 
and a fewer number on lighwer days (i.e.9 Sundays and Mondays). 

Because of complaints that officers were not being scheduled 
to work when they were really needed, the sergeant reviewed 
and posted the station policy on manpower needs and took 
over the Job of reviewing days off requests and tried to 
work them in with station needs. 

Two mtn requested the same day off. The sergeant explainc^d 
to them that the schedule would allow only one man to be 
off. After listening to their reasons £or wantlag the 
day off, the sergeant gave the day off to the officer who 
he felt had the greatest need. 

When unforeseen circxmistances caused a shortage of regular 
shift personnel, the sergeant pulled men from the power 
shift to fill the vacancies « 

When tiie shift in the phone complaint room waa short one 
man, the sergeant reqxieated a replacement from another 
division rather than take the shift's relief man from the 
dispatcher section. 

When two men put in for the same day off, the sergeant 
disapproved both applications so he wouldn't have to 
decide which man had the better reasons for wanting the 
time off. 

Because the sergeant was a "good guy", he approved all 
vacation and days off requests without worrying about 
finding replacements « 



SUPERVISION 



Job Category C 

Supervising subordinates where guidelines or standard operating pro- 
cedures exist; observing officers In the field to make sure they use 
proper procedures; warning and disciplining subordinates who are "out 
of line"; routine supervision at crime scene; evaluating subordinates. 
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Arriving at the scene oi^ a burglary involving considerable 
losSt the sergeant assigned officers to protect the area from 
becoming contaminated^ called for the investigative unit* and 
executed a preliminary search for evidence and witnesses. 

When days off were cancelled and one man said he was going 
to be "sick" so ha could take care of his part-time job/ the 
sergeant warned the man that if this was the case » he had 
better be at home because he would be checked on. 

When the sergeant heard a squad being sent to a call* be 
Isnediately drove to the scene and observietd the squad handle 
the call. 

After seeing an empty squad in front of a theater almost 
every night » the sergeant finally went in and found two 
patrolmen talking with the manager. When the officers told 
the sergeant they were just checking the theater* he said 
that was not their job and told them to stay away unless 
they receivfid a call to go there. _ 

When the sergeant arrived at the scene of an accident » he 
found that the patrolman was confused because it was his 
first accident investigation. The sergeant assigned him 
to direct traffic aad took over the investigation himself. 

The nergeant told some of his men Chat he had a list of the 
men on his shift who were "goof-offs", "slackers" » and 
"bums*\ and that he was paying special attention to them. 

A desk sergeant received e call from a patrolman asking 
for advice on a burglary with a large loss. The sergeant 
listened and told the patrolman^ **Tou*re on the scene^ 
you decide what to do." 

The sergeant told his men on two different occasions 
to pick up their mailt but they did not respond. The 
sergeant then shrugged his shoulders and said he would 
do it. 
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PERFORMING ADMINISTRATIVE AND INSPECTION FUNCTIONS 
Job Category D 

Keeping records and processing paper work; Inspecting men and vehi- 
cles; critiquing and writing reports. 



The sergeant vent over, a complaint report submitted by a 
patrolman, made the neces&ary changes » explained to the 
patrolman why the changes had to be made, and asked him 
to redo the report. 

^en the sergeant noticed that some officers were meeting 
depArtmental standards for appearance and equipment 
maintenance only on inspection days^ he began holding 
impromptu inspections. 

The sergeant made a dally inspection of all patrol cars, 
checking every area of the cars — the trunk, under the 
front and rear seats* etc. — and explained to the men the 
importance of proper inspection. 

When the sergeant wad assigned to find *^dLsslng radio 
pack sets, he posted a sign over the pack sets, stating 
that each would be signed out through the desk officer . 
who was to report any unaccounted sets to the sergerAt. 

The sergeant warned men who came to work in uniforms that 
were not up to standards that the situation should be 
corrected before the next inspection. He repeated this 
warning at each inspection. 

Because the sergeant disliked going over officers* 
reports for correct classifications, content, etc., he 
turned this responsibility over to a patrolman. 

The sergeant sent a memo to the inspector, but the 
inspector never received it. Because he had made no 
copies and kept no not^es, he could not remember all the 
details. He then wrote another memo which was consider* 
ably less detailed than the first. 

When the sergeant was assigned to carry out a yearly 
inspection of the department, he stated, '•Why? It won*t 
do «ny good anyway," copied the last year's report, and 
forgot about the matter. 
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DECISION MAKING AND INITIATIVE WHERE NO FIRM GUIDELINES EXIST 



Job Category E 

Making decisions where no guidelines or standard operating procedures 
exist; showing initiative; knowing when to get personally involved and 
when to delegate; reacting to unique or unusual emergency situations; 
show i ng I ead ersh i p*. 

9 

A sergeant was at the scene of a dance when the crowd became 
unruly and began destroying property. He called in available 
squads 9 formed them up in & nearby parking lot, got tHe 
inspector's permission to lead the men in z sweep of the 
sidevalkt which dispersed the crovd^ and then had squads 
patrol the immediate area. 

o 

When the sergeant arrived at the scene of a bar fight , he 
found that two women who were 1>eing restrained by officers 
were creating a loud disturbance which was drawing a crowd. 
The sergeant immediately had the women removed from the area 
and then waited for more squads to help remove six men who 
were also arrested. 

7 

When officers attempted to arrest a juvenile for possible rape 
charges, his mother physically sat on him and refused to move, 
claiming discrimination. The sergeant , noting the crowd of 
friends accumulating, called for more squads, and after 
attempting to persuade the mother to move, the suspect was 
forcibly removed while other officers formed a physical barrier. 

6 

When the sergemt arrived at the scene of an auto accident and 
saw a car had gone through a guard rail and plunged 30 feet 
to the ground, he called the ambulance, the rescue squad, 
and a tow truck. 

The sergeant at the scene of a residential burglary in progress 
call found all the doors locked aad no apparent sign of entry, 
though a neighbor said there was a light on that shouldn't have 
been on. He removed a screen, climbed into the hotise, and 
unlocked the doors to allow officers to search the house. 

k 

Wiile conducting a search for a wanted felon, a sergeant 
observed a group of militants forming.. He assembled his men 
into a riot formation and immediately began dispersing the 
crowd. 

A sergeant frequently made a special effort to drive by a 
local hangout to tag the cars illegally parked in front. 

2 

Before he arrived at the scene of a man with a gun call 
(without receiving further information), the sergeant had the 
dispatcher send the special sqiiad, gas, ambulance, dog squad 
and the inspector to the scene. 
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TRAINING AND PLANNING 



Job Category F 

Orierdting and training new recruits; thinking ahead so problems can 

avoided; participating effectively in staff planning meetings; 
planning for training; anticipating problems; analyzing officers' 
weaknesses ana suggesting training. 



A patrolman was unsure he handled the arrest of a traffic 
violator correctly, 80 he asked the sergeant for advise. The 
sergeant explained' the alternative ways the officer could have 
handled the situation and then discussed whether or not the 
officer had handled it correctly and how he would handle it 
if faced with the same situation again. 

A sergeant was reins true ting his men in the proper handling 
of a shotgun. He had each man unload and load, and then 
mmX up a shotgun just as it is to be found in the squad boot. 

Whenever the sergeant came across an article in a police 
magazine that he felt would benefit his patrolmen, he read 
it at roll call and commented on its interesting points. 

When the sergeant saw that the back-up squads were not 
responding quickly and that this was a station-wide problem, 
he requested, at a staff meeting, that a station policy be 
set up. 

When the sergeant was informer? by the lieutenant that his 
men were consistently leaving important details out of their 
reports, the sergeant mentioned the matter in passing at roll 
call» but didn't follow through. 

When a new patrolman was assigned to the precinct, the 
sergeant introduced him to the other, off icers and then 
assigned him to a squad with a poor performer. 

A sergeant was to present a roll call training session based 
on a slide projector presentation, but he knew little of its 
content because he had not bothered to check it out cp^letely 
prior to roll call* 

A sergeant never made any positive inputs during the monthly 
staff meetings and it was obvious that he didn't want to 
get involved in discussing problems and in establishing goals 
and priorities. 
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INTEGRITY, DEDICATION, AND CONSCIENTIOUSNESS 



Job Category G 

Refusing bribes and special favors; setting an example for patrol- 
men; self-development; working hard; showing a good attitude; 
behaving properly on and off duty. 



1 



The sergeant came to work 10 to 20 minutes early each day 
to exchange pertinent Information with the previous shift 
sergeant and clear up any work that was left at shift's end. 

A sergeant asked to be transferred to a difficult assignment 
to learn what he could In this position, and he did a good 
Job on the new assignment. 

A sergeant on patrol responded as quickly as possible to a 
robbery of business call and tried to apprehend the robbers 
in the area near where the incident had occurred. 

While patrollng, a sergeant observed a car with out-of-state 
license plates parked in an alley behind the house of people 
who had police records. When he checked on the car and 
found that it was stolen, he apprehended the driver. 

A. sergeant accepted some freshly caught fish from an 
officer. The sergeant gave the man the weekend off to go 
fishing as a favor, even though the shift was shott. 

A sergeant had instructed his men to enforce one hox^r parking 
in a business district, but later told hia men to "lay off" 
one block in the area, because a firm which gave police 
officers discounts had complained. 

Even though the sergeant told his men to use caution and 
good sense when driving, he was often seen driving very 
carelessly while on patrol 

While investigating the scene of a burglary, a sergeant 
stole three cartons of cigarettes. 



DEALING EFFECTIVELY WITH THE PUBLIC 



Job Catttgory H 

Hodiating between patrolmen and the pubHc; dealing courteously and 
constructively with citizen and community problems; dealing effec- 
tively with superiors; awareness of department politics. 



The sergeant kept checking the pos^Glble identity of a hoy who 
had been run over and killed by a bus ^untll he £ound the^bo;^ '^ 
mother. He stayed with the mother until the fa(;her came hocie. 
He then had & neighbor stay with the mother while he took the 
father to Identify the boy, 

A sergeant received a memo from an alderman about uumerous 
accidents at a partlculox Intersection, By checking through 
the T^raf fic Eaglneer^'s Office, he found that there had been only 
four accidents In a three-year period at the Intersection. 
The sergeant wrote the alderman a letter explaining why added 
police enforcement was denied. 

When the sergeant was encouraged by businessmen to assign 
two foot patrol officers to a specific area, he pointed out 
that this would be a waste of manpower, since crime patterns 
indicated that other areas should have priority. 

When two suspects threatened a false arrest suit, the sergeant 
advised them that they were stopped on probable cause and were 
free to go, though they could still make a complaint through 
proper channels and a follow-up investigation would be made. 

A sergeant told a citizen who felt he had been improperly 
tagged that there was nothing the sergeant could dp about It 
and the man would have to straighten it out with the Judge. 

When a sergeant requested additional equipment and his 
request was dropped, he enlisted the aid of his political 
friends if:o acquire the equipme^at. 

A clti2£«^ involved in a car accident asked the sergeant to 
drive his passenger five blocks to keep an appointment. The 
sergeant replied, '^e don' t run a taxi service." 

When a sergeant who was scheduled to speak at several cook 
munlty *'^pen forums'' failed to show up for them was asked why, 
he said thiat he was a poor public speaker and the meetings ' 
would ooljr a|gg^avate the bi^d community-police relations that 
already existed and, besides, the program was beyond the 
scope of normal police duty. 



OVE!MLL JOB PERFORMANCE 



Job Category I 

Consider here the overall performance of a subordinate you are rating 
The following should enter into your rating:' how welldoes he do the 
total job; how valuable Is he to the department; how much does he con 
tribute to the department's effectiveness. 



9^ 



g ^Mark in this range if you consider your subordinate 

^superior or outstanding. 



7 



N 

6 N 

N 

X 



I - *Mark In this range if you consider your subordinate 

satisfactory but not outstanding. 



3 



I 2 'Mark in this range if you have any reservations 

about considering your subordinate satisfactory. 
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JOB PERFORMANCE DESCRIPTION BOOKLET* 
f o r 

fNTERMEDlATE COMMANDERS 



* Feel free to page through this booklet before the rating session 
begins. The directions are more conv>llcated than the usual rating 
form — however, once you get the idea, the ratings are csasy to do 
and will go'quickly. 

PLEASE DO NOT START THE RATINGS UNTIL ALL DIRECTIONS-HAVE BEEN GIVEN. 
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JOB PERFORMANCE OESCRiPTiON SCALES 



INTERMEDIATE COMMANDERS 

Measuring job performance has always been an important issue for both 
supervisors and subordinates. Supervisors want to know how weH a man 
Is performing his job so thc't they can make decisions about him such as 
salary increases, promotions, etc. And all men, whether supervisors or 
subordinates, want to know how well they are doing their own job so that 
they can pay more attention to the things they do poorly and thereby 
improve. 

However, measuring job performance is a difficult thing to do. Though 
we all speak English, we quite often have a different understanding of 
what some common words mean, such as good, poor, average, etc. Because 
we differ in what we mean by these words, we often cannot agree on 
whether a person's job performance is "good," "average,." or "poor." 
Numbers don't help either, because people still have trouble agreeing 
on what they mean in terms of job performance. Another problem in 
measuring job performance is that most people find it hard to make up 
their minds about what the major characteristics are of what they want 
to measure. 

Let*s say you'were going to r^int a room brown for a friend. You show 
him the shade of paint you have and he says that the shade you have is 
"a lot less brown" than the shade he wants. So you change the combina- 
tion of colors and he says that the shade you have Is "not quite as 
brown" a$ the one he had in mind. You change the combination of colors 
that make up brown and he says, "That shade is a little less brown than 
I wanted;" It is clear that what your friend means by "a lot less 
brown," "not quite as brown," "a little too brown," etc. is not the same 
as what you mean by "a lot less brown," "not quite as brown," etc. This 
is an example of the problem people have with measuring things using 
words that are not closely related to the thing they are measuring, in 
this casn the color brown. 

If your friend had told you that the paint was too shiny, you would have 
known he was talking about something other than the shade of the paint, 
but what if he took the shininess of the paint Into account and didn't 
tell you? This is an example of having dl fferent ideas of what fs in- 
volved In measuring brownness. 

Well, you got smart and decided that you would make up a whole series 
of brown paint chips according to different combinations of colors and 
arrange them so that your friend could look at them and pick the shade 
he expected his room to be painted in. Of course, not every possible 
shade of broi;n was included in the colors you showed him, but the 
examples you had mapped out formed a scale of brown. 
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We have tried to develop Job performance rating scales for intermediate 
commanders that consist of about the same thing. Each scale is a list 
of possible examples of behavior. The examples form an outline of 
what is involved in doing one aspect of the job of an intermediate com- 
mander. The examples also serve as guideposts or trail markers along the 
scale, marking off more and more effective performance. 

We developed nine different rating scales plus an overall performance 
scale for the Job of intermediate commander, based on information pro- 
vided by intermediate commanders in a major metropolitan city. The 
names of these scales are: 



A. 


Administrative Duties 


B. 


Conmuni cat ions 


C. 


Scheduling 


-D. 


Training 


E. 


Supervis ion 


F. 


Commending, Disciplining, and Assigning Efficiency Ratings 


G. 


Field Command Situations 


H. 


Public and Community Relations 


1. 


Dedication, Integrity, Setting an Example 


J. 


Overall Job Performance 



instructions : In the booklet accompanying these directions you will find 
ten Job categories representing performance dimensions which are important 
for the Job success of investigators. Each Job category has immediately 
below it a definition of the category and eight performance examples 
gathered from policemen in a number of cities. Each performance example 
"anchors'* the portion of the scale opposite it. That is, on the Job 
category, ''Administrative Duties," the performance example which begins, 
"When additional equipment was needed . . •" represents the kind of 
behavior or performance which should be rated at eight or nine. Thus, 
the performance examples should help to define further the Job category 
and should provide "benchmarks" for defining points on the nine-point 
scales. 

In addition to the Job categories booklet containing the ten categories, 
their definitions, and the performance examples, we have provided you 
with a rating worksheet for each Job category with the names of the 
intermediate conmanders you will be rating on the left side of the work- 
sheets. You will then use these worksheets to record the ratings you 
assign to your subordinates. When you are ready to begin the rating task, 
you should first read over the definition and the performance examples for 
Job Category A, "Administrative Duties." Get the content of this Job 
category firmly in mind. Now consider the typical performance within 
this category of your first subordinate ratee. Compare his typical per- 
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formance with the performance represented by the eight '^benchmarks." 
Assign this man the rating which best typifies his level of performance 
In the area of "Administrative Duties" compared with the example anchors. 
Record that rating opposite his name on the worksheet. Then go on to the 
next subordinate and rate him on the same job category. When you have 
finished rating all of your subordinates on the first category, turn to 
the next category (Job Category B, "Communications") and proceed the 
same way you did for the first category. Follow the same procedures for 
the other nine categories as well. 

Things to guard against ; Several sources of error can contribute to 
inaccuracies in your ratings. Mentioning them briefly may help you to 
guard against making them. Here are suggestions for overcoming them: 

1) Consider each performance category separately frocri all the rest. 
An almost universal error in ratings is called HALO ERROR. It 
occurs when the rater gives about the same ratings to a person 

on all aspects of performance. Usually this error occurs because 
a rater has not really taken enough time to get clearly in mind 
what each separate category of performance refers to. Remember 
we are asking you to describe or rate each of your subordinates 
on ten categories of performance. As you consider each of the. 
persons you are rating try to avoid getting into the habit of 
giving about the same rating to him on each job category. Con- 
sider each category separately from all others. Be sure to 
rate all your subordinates on each category before going cn to 
the next category. 

2) Consider each subordinate's performance over time and not on 
just one or two occasions. Another type of error occurs when 
a rater is influenced by just some single event or some recent 
occurrence. As you consider each subordinate's performance,, 
think back over all the time you have known him and try to avoid 
being influenced by just one or two events. Base your ratings 
on all your observations of him and not just a few. 

3) Avoid being misled by such things as appearance, education, 
family background, and other personal characteristics. Another 
common error In rating is called STEREOTYPE ERROR. It occurs 
when a rater allows himself to be influenced by other things 
than what the person has actually done on the job. In cons Id" 
ering each subord inate' s job performance, try to ignore every- 
thing else you may know about that person. Give your rating 
based strictly on what the Individual has done on the job. 
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k) Avoid using your own definitions for the various job categories. 
A common reason for inaccurate ratings is because raters have 
different definitions of the Job categories. Terms such as 
'•Administrative Duties," ••Communications," and "Supervision," 
etc., can have different meanings for different raters. This 
Is why it is so very important for you to read the definitions 
and performance examples carefully for these job categories. 
Avoid any previous impressions of what these things have meant 
to you. Base your ratings on the definitions which are provided 
in the rating booklet you have received. 

Remember, these ratings will be used solely for the purpose of validating 
the experimental battery of tests given earlier to those persons you are 
rating. Neither performance evaluations nor test scores will be shown to 
any member of the police department. Thus, you should feel free to be 
open and honest in completing these ratings. Thank you very much for 
your cooperation. 
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ADMINISTRATIVE DUTIES 



Job Category A 

Preparing, reviewing, critiquing, and forwarding reports; setting up 
procedures for handling paper work; supervising equipment and station 
maintenance, requesting equipment; keeping appropriate and up-to-date 
records; analyzing computer statistics. 

-.9 

When additional equipment was needed For the precinct, the 
Intermediate Commander asked his immediate subordinates to 
write a request detai 1 ing the amount of equipment needed and 
the reasons for the equipment. He then added his own recom- 
mendations and thoughts and forwarded the request to Head- 
quarters with the names of all the men who worked on It. 

-8 

When the intermediate Commander who was responsible for all of 
the station records found that the job was too much for one man 
to handle, he assigned record keeping duties to sergeants, based 
on the kinds of records-the sergeants dealt with directly. He 
^ then spot checked the sergeants' record keeprng. 

The Intermediate Commander assigned one man the additional duty 
of coordinating all requests for equipment. The Intermediate 
Commander also made this man responsible for processing, receiv*- 
ing, and Inventory ing the equipment . 

- 6 

Vfhen the Intermediate Commander learned that all equipment had 
not been transferred to a new squad' car when the old car was 
replaced, he made arrangements with the garage to have all equip- 
ment transferred. 

- 5 

Because the station janitor d^d not work or weekends, the 
Intermediate Commander did tight cleaning and sweeping to 
keep the station c1e2r>. 

- k 

The Intermediate Commar t asked personnel to sabmft a list -of 
divisional equipment ne^Js, but then adopted a policy of 'Hjse 
the equipment already available, have it fixed If necessary, 
and make do." 

--3 

The Intermediate Commander never reviewed any reports, because 
he sstld It was just "busy work." 

An Intermediate Commander maintained a record system wTthIn his 
station that was unique to his station. He ignored repeated re- 
quests to upgrade his system to comply with the rest of fche city, 
because he maintained that his system was the best. 

1 
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COHHUNICATIONS 



Job Category B 

Holding staff meetings; listening to gripes; following the chain of 
command; obtaining and disseminating Information; providing reasons 
tor changes to Involved parties; keeping channels of communications 
open; exchanging information with other divisions. 




The intermediate Commander held monthly staff meetings to discuss 
problems and needed changes. The Intermediate Commander trltid to 
get everyone's opinion and suggestions before making a decision. 

When officer morale was low because rumors about plans for depart- 
mental reorganization were going around, the intermediate Cortinander 
advised administration of the problem and recjuerted an immediate re- 
lease of the reorganization plans to dispel further rumors. 



Because a newly established unit was the victim of jokes and ridi- 
cule by other operation units, the Intermediate Commander visited 
the heads of other urfits and tried to clarify any misunderstandings 
about the new unit. 

When many patrolemn requested transfers after a new Intermediate 
Commander took over the precinct, the Intermediate Commander asked 
his immediate subordinates if they knew why the men wanted transfers 
and how he could change their minds. 

Although the Intermediate Commander thoroughly briefed his men on 
changes in procedures, he never would answer questions about the 
reason for change. 

The Intermediate Commander got a call from a newly assigned Sgt. 
. requesting an appointment to talk about his new assignment. The 
Intermediate Commander would not work the Sgt. into his schedule 
and Just told him when to report. 

The Intermediate Commander attended division meetings, but did 
not take notes or tell subordinates what was discussed. 

A new Intermediate Commander with no supervisory experience d'ls- 
continued regular staff meetings, because he said he would be 
making all the decisions, anyway. 
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SCHEDULING 



Job Category C 

Matching manpower assignments with crime trends; developing crime 
pattern information; acting as a final arbiter in scheduling problems 
such as assigning days off, vacations etc.; being flexible when tak- 
ing scheduling problems into account; assigning details equitably; 
obtaining replacements to fill manpower shortages^ 



Because there was a high incidence of dwelling burglaries In hfs 
precinct, the Intermediate Commander used computer information on 
times, areas, M.O.*s etc., so he could detail surveillance men to 
saturate the areas at critical times. 

8 

With the increasing amount of walk-in traffic to the division, the 
Intermediate Commander assigned one man, on a rotating basis* to 
work inside and handle citizen problems. 

7 

The Intermediate Commander obtained a volunteer from the power 
shift to take a man's assignment for two weeks, because the 
officer's vacation had been rescheduled and he had already 
made reservations. 

6 

When an officer asked the Intermediate Commander for a day off 
on short notice to attend his child's christening, the Intermediate 
Commander refused his request because another officer had already 
asked for that day off in advance and he had a minimal crew. 

5 

When a patrolman asked an Intermediate Commander for a change in his 
beat, the Intermediate Commander said that he couldn't change the 
man's assignment at the time because six other patrolmen would be 
affected by a change. 

k 

An Intermediate Commander approved an officer's request for days 
off for a vacation without consulting his immediate subordinate 
about the i?ianpower resources for that peripd. 

3 

The Intermediate Commander responsible for making up monthly work 
sheets assigned plenty of men for the days he would be working and 
a lighter crew for those days when he wouldn^t be, making ft diffj- 
cult for the Sgt. to get the. job done when he was working alone. 

2 ; 

The 'Intermediate Commander frequently gave his men extra Friday and 
Saturday nights off, even though these were the heavy crime nt^nhtSp 
because he wanted to be a nice guy. 



TRASNINQ 



Job Category 0 

Developing and Instituting training programs; determining training 
needs; being aware of the training opportunities; evaluating the 
effect of training programs; doing on-the-job training by delegating 
authority; giving men experience on different jobs as a part of 
training. 



When the Intermediate Commander's station or unit began losing 
cases in court, he contacted the judge and the prosecuting 
attorney to find dut why. He then used their suggestions to 
»et up a roll call training program for his men. 

When the Intermediate Commander was informed that the county coroner 
was offering a one-hour training session on handling O.O.A. 's, he 
determined that there was a need for the training and set up the 
sessions for one hour before roll call. 

The Intermediate Commander set up a rotating policy of assigning 
patrolmen as acting Sgt. so that every qualified man had a chance 
of getting some training in supervising. 

The Intermediate Commander closely reviewed all training materials 
to see if they were worthwhile before scheduling the training pro- 
gram for his men. 

The Intermediate Commander did not ask If anyone needed or wanted 
training in first aid, but just set up some training in it. 

The Intermediate Commander instituted a training program for every 
police officer in the station which covered material that had been 
covered In another program three months earlier. 

An Intermediate Commander refused to schedule a short training pro- 
gram on community relations because he felt that other things were 
more Important. 

The station Intermediate Commander would not send any of his officers 
to available schools, because he said that he didn't believe in them. 
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SUPERVISION 



Job Cdt^gory E 

Observing subordinatfts' performance; specifying proper procedures 
for men to follow; following up to see if orders were carried out; 
delegating authority to others; providing feedbacl^ on day-to-day 
performance to subordinates. 



Mh^n 4n intermediate commander observed an officer malce an 
Illegal arrest, he immediately took the officer aside and told him 
how to correct his mistake. 

The Sg|t. had been pushing a group of poor performers hard and they 
complained to the intermediate comrr.-:^'der. The intermediate com- 
mander told them that if he were the Sgt. he would be doing the 
same thing, and that the pressure would continue until they 
shaped up* 

Because the Intermediate commander was concerned with the quality 
of arrests, he issued a policy stating that the sergeants must be 
present at the scene of felony arrests or must immecf lately review 
all felony arrests. 

The Intermediate commander continuously checked every case assigned 
to his division to be sure that it was handled correctly, and fre- 
quently called his men to be sure they had completed their 
responsibilities. 

WheB a Sgt. requested that a patrolman who wasn't performing effec- 
tively be taken off squad duty and assigned to a beat, the inter- 
mediate commander told the Sgt. to do as he pleased with the 
patrolman. 

The Intermediate commander did not permit his officers to change 
their assigned schedules without his consent, and he did not dele- 
gate any authority to his subordinates. 

An Intermediate commander always second-guessed his men and made 
decisions for them. That is, he always asked them if they had 
done this or that, and then told them what they should do and how 
to go about it. 

The Intermediate commander allowed a Sgt. to harass and berate 
some newly appointed patrolmen, because he thought getting chewed 
out and razzed would be good for them, even if they didn't really 
deserve it. 
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COHHENOING, 0 ISC IPL INING» AND ASSIGNING EFFICIENCY RATINGS 



t» Category F 

Obtaining factual information before acting on corranendat ions or dis- 
ciplinary actions; disciplining men in private; making commendations 
public; fitting the disciplinary action to the incident; facing up to 
disciplinary problems; discussing ratings with immediate supervisors; 
reviewing ratings with men; being unbiased when making ratings. 

9 

The Intermediate Commander reviewed all arrest reports and conferred 
with his immediate subordinates on instances of outstanding 
performance, recommending supervisors place selected men in for 
commendations. He followed up these incidents to make sure the 
commendaticr>5 request was submitted. 

8 

When a patrolman who had a drinking problem was found drinking 
on duty, the Intermediate Commander referred him to higher 
authorities for discipline, but requested that he not be trans- 
ferred. The Intermediate Commander also assisted the man In 
^ Joining an AA group. 

The Intermediate Commander called his immediate subordinates 
into his office to discuss discrepancies and differences between 
^ their efficiency ratings. 

When the Intermediate Commander discovered that a squad had stopped 
to talk to a citizen on the way to an ''assault in progress" (and the 
assailant had been apprehended by the backup squad), he recommended 
to his superior that disciplinary action be taken. 

5 

When officers apprehended a suspect in a remote area with the help 
of a'police dog, a Sgt- recommended that the men be given citations. 
The Intermediate Commander, however, upon reviewing the facts, 
decided that only the dog's action was outstanding and the officers 
were only performing routine functions, so he decided against a 
citation. 

The Intermediate Commander gave high rartings only to officers who 
did something spectacular or heroic. The steady performers who 
did their jobs just got average ratings. 

3 

When the Intermediate Commander received a complaint from a 
community leader that one of his patrolmen had struck a black youth 
without provocation, he called the officer in and severely reprimanded 
him without asking for his side of the story. 

2 

An Intermediate Commander received a written report from a field Sgt. 
that an officer was drinking on duty, but he tore up the report. A 
week later when the inspector observed the problem and told the 
Intermediate Commander, the Intermed late C.oninander chewed out the 
Sgt. for not stopping the problem. 

1 ■ 
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FIELD COHHAND SITUATIONS 



Job Cattigory G 

Making decisions about courses of action; coordinating personnel at 
a crime scene, civil disturbance, disaster, etc.; deploying men to 
control the scene; exercising caution in dangerous situations; super* 
vising a field si tuation until resolved or properly relieved. 



When a serious disturbance arose wlilch required cars from all over 
the city to assist, the intermediate Commander had a Sgt. taice over 
the station and went to the scene to set up a temporary command post. 
He directed activities until he was relieved by an Inspector. 

Because a Sgt. was not available for on-scene supervision at a civil 
disturbance, the Intermediate Commander immediately responded and took 
command of the scene with his own officers, and without having to call 
in other supervisors or units. 

An Intermediate Commander at a fatal HVA took charge by ordering a 
Sgt. to handle rescue operations and he himself posted traffic con- 
trol officers and had firemen rope off a pedestrian area to keep the 
crowd under control. 

An Intermediate Commander talked with investigators at the scene of a 
shooting and took responslbil ity for protecting the scene. He Instructed 
his men, deployed them^ and then left. 

At the scene of a bomb threat^ the hitermedlate Commancfar did not 
send his men to evacuate adjoining buildings. 

An Intermediate Commander told a Sgt. to take co?dmand of the men at 
the scene of a factory explosion and then left* 

When two men fled from a robbery and entered an unlocked apartment » 
the Intermediate Commander ordered tear gas to be fired Into the 
apartment, but he didn't ask the tenant which windows were hers. 
Thus, tear gas was fired into the adjacent apartments as well^ caus- 
ing expensive clean-up costs. 

The Intermediate Commander entered the scene of a homicide and 
touched numerous articles that might have been valuable as evi- 
dence had he left them a I cine. 
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PUBLIC AND COHHUNlTY RELATIONS 



Job Category H 

DMiing courteously and constructively with community problems; work- 
ing with community groups; dealing with the public both in the station 
and out on the street; providing a good public Image* 



3 

When an Intermediate Commander took over a precinct, he went to all 
of the schools, introduced himself to the principals, and told them 
to feel free to call him if he could be of service. 

8 

When a well-known community leader died, the Intermediate Commander 
sent flowers to the funeral parlor and then paid his respects. 

7 

An Intermediate Commander told a group of black community leaders 
that he didn't care \f a lawbreaker was black, red, green, or blue — 
he still would be treated like any other lawbreaker. 

The Intermediate Commander called a citizen who had registered a 
complaint against one of his men and explained to him the officer's 
version of the story tO show him something was being done about the 
incident. 

5 

When a large PTA group called the Intermediate Commander and asked 
for him to speak to them on youth and drugs, he referred them to the 
Juvenile Division wfthoUt following up to see that they got a speaker. 

k 

A group of businessmen requested an appointment with the Intermediate 
Commander to discuss problems in the area. The Intermediate Commander 
set up , the appointment and then had his immediate subordinate, who 
was also familiar with the area's problems, keep the appointment. 

3 

The Intermediate Commander kept a community leader who had a complaint 
about a recent incident waiting for 45 minutes while he finished his 
lunch. 

2 

The Intermediate Commander refused to talk to a group of concerned 
citizens about community problems, stating this was not part of his 
Job. 

1 



DEDICATION, INTEGRITY, SETTING AN EXAMPLE 



Job Category I 

Serving as a model for subordinates; abiding by all department rutes 
and regulations; accepting rather than avoiding one ^s job responsi- 
bilities; avoiding acts that might be construed as compromising one's 
integrity. 



An Intermediate Commander postponed his vacation because there was 
an outbreak of bombing and bomb threats. 

The Intermediate Commander took night school courses to Improve 
his managerial skills. 

The Intermediate Commander made periodic checks of the station 
at various shifts to make closer contact with his field personnel 
to see if there wert*: any problems he could help solve. 

The Intermediate Commander gave a full eight hours to the Job, 
but he rarely became involved in anything beyond his daily 
duties. 

The Intermediate Commander accepted a case of liquor for whe 
station party from a liquor store in the precinct. 

An Intermediate Commander came to work at 10 a.m. wearing 
uniform trousers and a t-shirt. He called for a squad to pick 
up his shirts at the laundry and bring them to the station so 
he. could get dressed for the Job. 

An Intermediate Commander conducting inspection berated officers 
for their sloppy appearance, even though he was wearing an unpressed, 
unclean uniform; unauthorized wing-tip shoes, and other nonregulation 
items, and had a cigar in his mouth. 

An officer arrested and brought In two black suspects and explained 
the charges to the Intermediate Commander. The Intermediate 
Command'jr realized the charges were too vague, but he booked them 
to avoid being called a '^nigger lover.*' 



1 a{< 



OVERALL JOB PERFORMANCE 



Job Category J 

Consider here the overall performance of a subordinate you are rating. 
The following should enter Into your rating: how well does he do the 
total Job; how valuable is he ;:o the department; how much does he con- 
tribute to tho department's effectiveness. 



3 ^Mark in this range if you.jQonsider your subordinate 

^superior or outstanding. 

4- 7 



N 

J- 6 ^ 



I r *Mark in this range if you consider your subordinate 

^satisfactory but not outstanding. 



3 



"Hark In this range If you have any reservations 
about considering your subordinate satisfactory. 



APPENDIX B 

TABLES SHOWING INTERRATER RELIABILITY 
ESTIMATES FOR JOB PERFORMANCE RATINGS 
SEPARATELY, BY CITY, FOR DETECTIVES, 
SERGEANTS, AND MIDDLE COMMAND PERSONNEL 
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Table 1 



Interrater ReUability Estimates* 
for Job Performance Ratings for Cincinnati Detectives 
(N«65) 









Estimate Based on 






Estimate Based on 


Spearm an-B rown 




Overall 


Raters with Two 


Correction to 


Dimension 


Estimate 


Ratbg"; OnEy (N»19) 


Two Raters (K«2) 


A Investigating a Crime 


62 


78 


67 


B Arrest, Search, Seizure 


61 


75 


66 


C Interrogation 


71 


70 


76 


D Investigating a Case 


52 


68 


57 


E Developing Informants 


72 


76 


76 


F Report Writing 


45 


52 


51 


G "Appearing in Court . 


0 


05 


0 


H Public Relations 


48 


58 


54 


I Juveniles 


13 


36 


17 


J Cooperation 


58 


62 


63 


K Dedication 


48 


72 


55 


L Integrity 


02 


24 


02 


M Overall Rating 


60 


73 


66 


Sum of Ratings 


68 


78 


73 



Mean Number of Raters (K) 1.55 

. *Occim«ls omiiied. 



Table 2 

Interrater Reliability Estimates* 
for Job Performance Ratings for Des Moines Detectives 
(N « 33) 



Estimate Based on 

T - ' t Estimate Based on Spearman-Brown 

Overall ' Ratere^^with Two Conection to 

Dimension Estimate Ratings Only (N=21) Two Raters (K»2) 



A 


Investigating a Crime 


30 


-26 


32 


B 


Arrest, Search, Seizure 


-51 


-1.35 


0 


C 


Interrogation 


40 


45 


42 


D 


Investigating a Case 


64 


57 


67 


E 


Developing Informants 


59 


54 


62 


F 


Report Writing 


18 


05 


20 


G 


Appearing in Court 


43 


27 


46 


H 


Public Relations 


29 


-12 


31 


I 


Juveniles • 


28 


15 


30 


J 


Cooperation 


51 




53 


K 


Dedication 


45 


47 


48 


L 


Integrity 


-85 


-46 


0 


M 


Overall Rating 


65 


49 


68 




Sum of Ratings 


48 


30 


51 




Mean Number of Raters (K) 


1.80 







'Dccimalk omilled. 
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Table 3 



Interrater Reliability Estimates^ 
for Job Performance Ratings for Miami (Dade Co.) Detectives 

(N = 95) 



Estimate Based on 
Estimate Based on Spearman-Brown 



Dimension 


Overall 
Estimate 


I\alvt9 wiui 1 Wl/ 

Ratings Only (N='52) 


Two Raters (K 


A Invectiffatinp a Crime 


48 


46 


54 


B Arrest, Search, Seizure 


59 


70 


64 


C Interrogation 


35 


45 


40 


D Investigating a Case 


51 


54 


57 


E Developing Informants 


-13 


-27 


0 


F Report Writing 


-33 


-38 


0 


G Appearing in Court 


14 


-02 


18 


H Public Relations 


-23 


-06 


0 


I Juveniles 


-39 


-34 . 


0 


J Cooperation 


28 


19 


33 


K Dedication 


-11 


0 


0 


L Integrity 


-39 


-1,26 


0 


M Overall Rating 


56 


56 


62 


Sum of Ratings 


24 


28 


29 


Mean Number of Raters (K) 


1,60 







'Decimals omined. 



Table 4 



Interrater Reliability Estimates^ 
for Job Performance Ratings for Minneapolis Detectives 
(N = 55) 











Estimate Based on ' 








Estimate Based on 


Spearman-Brown 






Overall 


Raters with Two- 


Correction to 




Dimension 


Estimate 


Ratings Only (N=31) 


Two Raters (K»2) 


A 


Investigating a Crime 


80 


80 


80 


B 


Arrest, Search, Seizure 


65 


73 


65 


C 


Interrogation 


56 


65 


55 


D 


Investigating a Case 


70 


66 


69 


E 


Developing Informants 


53 


41 


52 


F 


Report Writing 


57 


66 


56 


G 


Appearing in Court 


25 


06 


25 


H 


Public Relations 


64 


69 


63 


1 


Juveniles 


28 




39 


J 


Cooperation 


55 


49 


54 


K 


Dedication 


60 


58 


59 


L 


Integrity 


50 


56 


49 


M 


Overall Rating 


75 


69 


74 




Sum of Ratings 


74 


74 


73 



Mean Number of Raters (K) 



2.00 



'DeciiniiU entitled. 



170 



Table 5 



Interrater Reliability Estimates'^ 
for Job Performance Ratings for Portland Detectives 
(N= 58) 









; 

Estimate Based on 






Estimate Based on 


Spearman'Brown 




Overall 


Raters with Two 


Correction to 


Dimension 


Estimate 


Ratmgs Only (N= 16) 


iwo Katers 


A Investigating a Crime 


67 


70 


74 


B Arrest, Search, Seizure 


23 


06 


29 


C Interrogation 


15 


-09 


20 


D Invesfifffltinir a Case 


53 


-08 


61 


E Developing Informants 


23 


48 


29 


F Report Writing 


44 


06 


52 


G Appearing in Court 


15 


-32 


21 


H Public Relations 


25 


-14 


32 


I Juveniles 


13 


OS 


18 


J Cooperation 


27 


-45 


34 


K Dedication 


63 


43 


70 


L Integrity 


57 


55 


64 


M Overall Rating 


58 . 


58 


66 


Sum of Ratings 


50 


40 


58 


Mean Number of Raters (K) 


1.45 







*IDocimals omttlcd. 



Table 6 



Interrater Reliability Estimates* 
for Job Peiformance Ratings for Washington, D. C. Detectives 

(N = 90) . 



Dimension 



Overall 
Estimate 



RaiC'.'^ ^ fi'-h 'J' wo 
Ratj-i^r* Oni.v •:?^=30) 



Estimate Based on 
Spearman-Brown 

Correction to 
Two Raters (K=2) 



A Investigating a Crime 66 

B Ajtc5(, Scaxch, Seizure 27 

C Interrogation 44 

D Investigating a Case 46 

E Developing Informants 14 

F Report Writing 18 

G Appeving in Court 55 

H Public Relations -03 

I Juveniles 05 

J Cocperation 28 

K Dedication 25 

L Integrity 12 

M Overall Rating '0 

Sum of Ratings 42 

Mean Number of Raters (K) 1 .50 



71 
35 
35 
52 

-07 
-06 
-76 
21 
38 
28 



72 
33 
52 
54 
19 
23 
62 
I) 
OP 

^^ 
ii 

!5 
36 

J9 



*Deciinali omitted. 
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Table? 

Interrater Reliability Estimates'^ 
for Job Performance Ratings for Cincinnati Sergeants 
(N = 74) • 



Estimate Based on 
Estimutcs Based on Spearman-Brown 







Overall 


Rite ySvli Two 


Correction to 




Dimension 


Estimate 


Ratings Ofyjy (N=k44) 


Two Raters (K— 2) 


A 


Concern for Subordinates 


30 




34 


B 


Coordination and Deploy- 


48 


42 


54 




ment 








C 


Supervision 


42 


38 


47 


D 


Administration and 


04 


09 


OS 




Inspection 








E 


Decision Making and 


30 




35 




Initiative 








F 


Training and Planning 


49 


55 


55 


0 


Dedication 


68 


71 


75 


H 


Public Contact 


52 


56 


58 


I 


Overall Rating 


64 


65 


69 




Sum of Ratings ' 


52 


53 


58 




, Mean Number of Raters (K) 


1.60 







*Decinub omined. 



Table ?- 

Imerrater RehabiUty Estimates'^ 
for Job Performance Rat:rt<^s for Des Moines Sergeants 



Estimate Based on 
Estimate Based on Spearman-Brown 
0".Tr;iil Raters with Two Correction to 

Dimension f!,*Umate Ratings Only (N=30) Two Raters (K-2) 



A 


Concern for Subordinates 


:*4 


45 


39 


B 


Coordination and Deploy- 


55 


60 


60 




ment 








C 


Supervisiai*. 


64 


71 


68 


D 


Administration and 


62 


74 


67 




Inspection 








E 


Decision Making and 


28 


43 


33 




Initiative 








F 


Training &fld Planning 


49 


53 


54 


G 


Dedication 


.v5 


65 


60 


H 


Public Contact 


63 


65 


67 


I 


Overall Rating 


70 


75 


74 




Sum of Ratings 


72 


78 


75 




Mean Number of Raters (K) 


1.65 







*Dccim«ls omined. 
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Table 9 



Interrater Reliability Estimates* 
for Job Performance Ratings for Miami (Dade Co.) Sergeants 

(N = 51) 











Estimate Based on 








csiimaic oascQ uii 


S pearman -B ro wn 






Overall 


Raters with Two 


f nrreclinn lo 




Dimension 


Estimate 


Kaiings yjuiy yrt—o^) 


Two Raters (K=2) 


A 


Concern for Subordinates 


53 


60 


58 


B 


Coordination and Deploy- 
ment 


61 


56 


50 


C 


Supervision 


67 


70 


71 


D 


Administration &nd 


46 


27 


51 




Inspection 


43 


45 


48 


E 


Decision MakrJ-: and 




Initiative 






61 


F 


Training and OiMi iji 


56 


61 


G 


Dedication 


36 


52 


40 


H 


Public Contact 


43 


40 


47 


1 


Overall Rating 


59 


61 


63 




Sum of Ratings 


69 


68 


72 




Mean Number of Raters (K) 


K65 







*D«cin)aU omiileti. 



Table 10 

Interrater Reliability Estimates* 
for Job Performance Ratings for Minneapolis Sergeants 
(N = 40) 



Estimate Based on 
Estimate Based on Spearman-Brown 







Overall 


Raters with Two 


Correction to 




Dimension 


Estimate 


Ratings Only (N=13) 


Two Raters (K=2) 


A 


Concern for Subordinates 


55 


54 


44 


B 


Coordination and Deploy- 


45 • 


47 


34 




ment 






28 


C 


Supervision 


37 


34 


D 


' Administration and 


37 


03 


27 




Inspection 




33 


*37 


E 


Decision Making and' 


47 




Initiative - 






53 
30 


F 


Training and Planning 


63 


85 


G 


Dedication 


40 


-22 


H 


Public Contact 


50 


04 


40 


I 


Overall Rating 


62 


63 


52 




Sum of Ratings 


61 


47 


50 




Mean Number of Raters (K) 


3.10 







*Decifnits omined. 
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Table 1 1 



Interrater Reliability Estimates* for Job Performance Ratings for Portland Sergeants 

(N = 16) 





Dimension 


vyvui all 

Estimate 


Estimate Based on 

iNBlCrs WJUl I wu 

Katings uniy 


Estimate Based on 
Spearman-Brown 

^vrTcciiuii lu 
1 WO Xaters \ls,=2) 


A 


Concern for Subordinates 


-16 


02 


0 


B 


Coordination and Deploy- 


-47 


-08 


0 




ment 








C 


Supervision 


52 


63 


57 


D 


Administration and 


38 


08 


42 




Inspection 








E 


Decision Makijig and 


28 


-80 


32 




Initiative 








F 


Training and Planning 


-08 


56 


0 


G 


Dedication 


-07 


-05 


0 


H 


Public Contact 


-57 


-29 


0 


I 


Overall Rating 


-13 


63 


0 




Sum of Ratings 


10 


55 


12 




Mean Number of Raters (K) 


1.67 







*OcctmaJs omitted. 
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Table 12 

Interrater Reliability Estimates* for Job Performance Ratings for San Diego Sergeants 

(N = 52) 



Estimate Based on 









Estimate Based on 


Spearman-Brown 






OverrJl 


Raters with Two 


Correction to 




Dimension 


Estimate 


Ratings Only (N=26) 


Two Raters (K=2) 


A 


Concern for Subordinates 


29 


01 


34 


B 


Coordination and Deploy- 


11 


-10 


13 




ment 








C 


Supervision ' ' 


46 


29 


53 


D 


Administration and 


49 


48 


55 




Inspection 








E 


Decision Making and 


40 


-48 


46 




Initiative 








F 


Training and Planning 


28 


04 


33 


G 


Dedication 


36 


29 


43 


H 


Public Contact 


06 


39 


08 


I 


Overall Rating 


24 


01 


30 




Sum of Ratings 


34 


10 


40 




Mean Number of Raters (K) 


1.50 







*Dectinali 
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Table 13 



Inierrater Reliability Estimates* for Job Performance Rating: 
for Washington, D. C. Sergeants 

(N - 88) 



Estinuii b i 3n 
Estimate Based on Speanni: B'^'^wn 

Overall Raters with Two Correcl^o^ to 

DimentkMi Estimate Ratings G^ly (N«24) Two Raters (K«2) 



A 


Concern for Subordinates 


30 


43 


39 


B 


Coordination and Deploy* 


32 


20 


41 




ment 








C 


Supervision ' 


46 


56 


55 


D 


Administration and 


51 


54 


64 




Inspection 








E 


Decision Making and 


10 


44 


14 




Initiative 








F 


Training and Planning 


49 


45 


58 


0 


Dedication 


12 


37 




H 


Public Contact • 


20 


41 


27 


I 


Overall Rating 


70 


80 


78 




Sum of Ratings 


63 


71 


71 




Mean Number of Raters (K) 


1.35 







*Deciiiiab ocnioed. 



Table 14 

Interrater Reliml^^stimates* for Job Performance 
Ratings for ybes^oines Middle Level Officers 
(N = 23) 









Estimate Based on 






Estimate Based on 


Spearman-Brown 




^^erall 


Raters widti Two 


Correction to 


Dimension 


Estimate 


Ratings Only (N»8) 


Two Raters (K«2} 


A Administrative 


60 


68 


69 


B Communications 


09 


08 


13 


C Scheduling 


64 


67 


72 


D Training 


59 


68 


69 


E Superviuon 


0 


-1.90 


0 


F Subordinate Evaluation 


26 


-71 


34 


G Field Command 


-33 


-20 


0 


H Public Relations 


39 


-. 58 


49 


I Dedication 


34 


23 


44 


J Overall Perfonnance 


45 


28 


55 


Sum-of Ratings 


59 


43 


68 


Mean Number of Raters (K) 


1.34 







*DerifMli omimd. 
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Table 15 



Interrater Reliability Esiimates* for Job Performance 
Ratings for Miami (Dade Co.) Middle Level Officers 
(N = 31) 











.Estimate Based on 








Estimate Based on 


Spearman-Brown 






uverau 


Raters with Two 


Correction to 




Dimension 


CSlUildlC 


Patinnc Onli/ ^M*~in\ 
I\aiing9 ^^ly \Vi — iM) 


1 wu ixaiers ^iv— 


A 


Administrative 


47 


. 27 


57 


B 


Communications 


43 


27 


53 - 


C 


Scheduling 


09 


-40 


13 


D 


Training 


38 


-1.00 


49 


E 


Supervision 


37 


41 


48 


F 


Subordinate Evaluation 


85 


89 


89 


G 


Field Command 


0 


-38 


0 


H 


Public Relations 


-31 


-2.10 


0 


I 


Dedication 


51 


67 


61 


J 


Overall Performance 


24 


38 


33 




Sum of Ratings 


46 


39 


56 




Mean Number of Raters (K) 


1.32 







*Oecinwls omiiled. 



Table 16 

Interrater Reliability Estimates'^ for Job Performance 
Ratings for Minneapolis Middle Level Officers 
(N = 28) 



Estimate Based on 
Estimate Based on Speannan-Brown 
.Overall Raters with Two Correction to 

Dimension Estimate Ratings Only (N== 12) Two Raters (K=2) 



A 


Administrative 


63 


65 


71 


B 


Communications 


77 


87 


83 


C 


Scheduling 


28 


-16 


35 


D 


Training 


64 


■ 77 


72 


E 


Supervision 


01 


-39 ' 


01 


F 


Subordinate Evaluation 


66 


67 


73 


G 


Field Command 


24 


-97 


30 


H 


Public Relations 


10 


40 


14 




Dedication 


53 


23 


61 


J 


Overall Performance 


68 


71 


75 




.Sum of Ratings 


55 


62 


63 




Mean Number of Raters (K) 


1.42 







*Oecinuih omtUed. 
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Table 17 



Interrcaer Reliability Estimates'^ for Job Performance 
Ratings for Portland Middle Level Officers 
(N»2I) 















ESiimaie oascu on 


^n^nrm nn -R rou/n 




uveraii 


ixaicrs WlUl I WU 


f^nrrectinn to 


i^iniciisioii 




Ratings Only (N=12) 


Two Raters (K— 2) 


A Administrative 


64 


52 


65 


B Communications 


65 


19 


66 


C Scheduling 


22 


62 


23 


D Training 


37 


55 


38 


E Supervision 


78 


75 


79 


F Subordinate Evaluation 


40 


14 


42 


G Field Command 


59 


42 


61 


H Public Relations 


02 


-49 


02 


I Dedication 


58 


64 


60 


J Overall Perfonnance 


69 


46 ■ 


70 


Sum of Ratings 


• 67 


48 


68 


Mean Number of Raters (K) 


L89 







*Oecimilk omitted. 



Table 18 



Inter rater Reliability Estimates'*^ for Job Performance 
Ratings for Washington, D. C. Middle Level Officers 

(N - 47) 









Estimate Based on 






Estimate Based on 


Spearman-Brown 




Overall 


Raters with Two 


Correction to 


Dimension 


Estimate 


Ratings Only (N-16) 


Two Raters (K=2) 


A Administrative 


50 


75 


56 


B Communications 


38 


48 


43 


C Scheduling 


38 


22 


44 


D Training 


31 


-35 


37 


E Supervision 


53 


68 


61 


F Subordinate Evaluation 


46 


76 


53 


G Field Command 


46 


-81 


53 


H Public Relations 


0 


20 


0 


I Dedication 


12 


18 


- 15 


J Overall Performance 


59 


52 


66 


Sum of Ratings 


58 


66 


64 



Mean Number of Raters (K) I M 



*Dccimal» omitted. 
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APPENDIX C 

SAMPLE SIZES, MEANS, AND STANDARD DEVIATIONS 
OF JOB PERFORMANCE DIMENSION RATINGS; AND 
CORRELATION MATRICES BETWEEN PERFORMANCE 
RATINGS FOR EACH OF FOUR POLICE JOB AREAS 
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Table 1 



Sample Sizes, Means, and Standard Deviations of Performance Ratings 
for Patrol Oj%erK With Both Test and Rating Information 



I^UuCllMUi] 


N 


Mean 


Standard 
Deviation 


A Crime Prevention 


618 


6.10 


1.36 


B Use of Force 


626 


6.06 


1.26 


C Traffic Control 


591 


6.36 


1.44 


D Public Safety 


465 


6.53 


1.18 


E Investigation 


363 


6.84 


1.28 


F Rq)ort Writing 


702 


6.28 


1.30 


G Ethical Conduct 


593 


7.12 


1.18 


H Dealing with the Public 


542 


6.38 


1.17 


I Demesne Disputes 


360 


6.49 


1.19 


J Commitment 


522 


6.66 


1.57 


K Teamwork 


520 


7.0" 


1.34 


L Overall Rating 


700 


6.31 


1.37 


M Mean of All Ratings 


705- 


6.47 


1.02 



Table 2 



Correlation Coefficients'' {Based on Pair-Wise Deletion) Between Job Performance 
Rating Dimensions for Patrol Officers With Both Test and Rating Information 





Dimension 


A 


B 


C 


D 


E 


F 


G 


H 


I 


J 


K 


L M 




Crime Prevention 


























b 


Use of Force 


32 
























c 


Traffic Control 


61 • 


34 






















D 


Public Safety 


60 


25 


61 




















E 


Investigation 


76 


28 


60 


69 


















F 


Report Writing 


56 


31 


52 


62 


71 
















G 


Ethical Conduct 


48 


28 


49 


50 


47 


44 














H 


Dealing with the Public 


50 


56 


56 


50 


32 


50 


50 












I 


Domestic Disputes 


52 


62 


57 


51 


53 


55 


39 


73 


54 








J 


Commitment 


63 


23 


58 


68 


70 


58 


55 


54 


60 






K 


Teamwork 


49 


18' 


54 


66 


67 


51 


40 


56 


57 


62 




L 


Overall Rating 


73 


36 


70 


65 


77 


63 


58 


59 


60 


75 


88 .. 


M 


Mean of All Ratings 


79 


52 


79 


75 


83 


75 


69 


76 


75 


82 


73 



*DMiniaU omttied. 
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Table 3 



Sample Sizes, Means, and Standard Deviations of Performance Ratings for Detectives 
With Both Test and Rating Information 





Dimension 


N 


Mean 


Standard 
Deviation 




!:'\vcs(igatuig a Crime 


377 


6.45 


1.56 


B 


A.ife>(, SiTijrcht Seizure 


334 


6.59 


1.48 


C 


Inttrrog&tion 


361 


6.39 


1.44 


D 


Investigating a Case 


411 


6.49 


1.56 


E 


Dev'<?k>ping Informants 


209 


6.18 


1.89 


F 


Report Writing 


' 233 


6.54 


1.47 


G 


Appearing in Court 


104 


6M 


1.29 


H 


Public Relations 


294 


6.62 


1.46 . 


1 


Juveniles 


178 


6.62 


1.53 


J 


Cooperation 


219 


6.63 


1.56 


K 


Dedication 


205 


6.32 


1 70 


L 


Integrity 


214 


7,63 


1.46 


M 


Overall Rating 


415 


6.51 


1.45 


N 


Mean of All Ratings 


415 


6.59 


1.15 



Table 4 

Correlation Coefficients* (Based on Pair-Wise Deletion) Between Job Performance 
Rating Dimensions for Detectives With Both Test and Rating Information 

Dimension A BCDEFGHI 3 K L M N 

A Investigating a Crime 



B Arrest, Search, Seizure 


72 


















C Interrogation 


63 


61 
















D Investigating a Case 


68 


62 


61 














E Developing Informants 


57 


57 


58 


62 












F n^rt Writing 


53 


57 


36 


55 


39 










G Appearing in Court 


59 


66 


63 


69 


61 


68 








H . Public Relations 


38 


43 


53 


40 


38 


41 


61 






1 Juveniles 


35 


34 


44 


43 


48 


27 


40 


50 




j Cooperation 


51 


57 


54 


58 


43 


51 


58 


59 


45 


K Dedication 


73 


68 


61 


75 


60 


60 


65 


50 


50 


L Integrity 


39 


35 


36 


32 


48 


44 


72 


34 


55 


M Overall Rating 


72 


69 


65 


74 


62 


57 


73 


53 


41 


N Mean of All Ratings 


81 


80 


78 


83 


75 


68 


83 


65 


60 



*[>ecinuis omitted. 
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Table 5 



Sample Sizes, Means, and Standard Deviations of Performance Ratings 
for Sergeants With Both Test and Rating Infornuuion 



Dimension 


N 


Mean 


Standard 
Deviation 


A Concern for Subordinates 


350 


7.05 


1.43 


B Coordination and Deployment 


298 


6.'39 


1.71 


C Supervision 


359 


6.85 


1.59 


D Administration and Inspection 


284 


6.43 


1.76 


E Decision Making Initiative 


349 


6.72 


1.39 


F Training and Pt&nning 


363 


1 6.32 


1.68 


G Dedication 


352 ^ 


7.14 


1.41 


H Public Contact 


352 


6.76 


1.42 


1 Overall Rating 


362 


6.45 


1.46 


J Mean of All Ratings 


365 


6.71 


1. 17 



Table 6 

Correlation Coefficients* {Based on Pair-Wise Deletion) Between Job Performance 
Rating Dimensions for Sergeants With Both Test and Rating Information 

Dimension ABCDEFGHI J 

Concern for Subordinates 





Coordination and Deployment 


49 ' 














C 


Supervision 


48 


64 












D 


Administration and Inspection 


36 


57 


59 










E 


Decision Making Initiative 


48 


52 


58 


49 








F 


Training and Planning 


51 


55 


53 


58 


46 






Q 


Dedication 


47 


48 


45 


48 


52 


54 




H 


Public Contact 


. 50 


45 


47 


46 


41 


56 


55 


I 


Overall Rating 


60 


66 


64 


68 


66 


70 


69 


J 


Mean of All Ratings 


. 70 


79 


78 


77 


74 


79 


75 



*l>Kimds omiticd. 
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Table 7 



Sample Sizes, Means, and Standard Deviations of Performance Ratings 
for Middle Level Officers With Both Test and Rating Information 



Dimension 




Mean 


Standard 
Deviation 


A Administrative "*"^ 


204 


6.62 


1.50 


B Communications 


186 


6.62 


1.55 


C Scheduling 


172 


6.59 


1.71 


D Training 


204 


6.50 


1.64 


E Supervision 


158 


6.85 


1.45 


F Subordinate Evaluation 


186 


6.83 


1.62 


G Field Command 


150 


7.10 


1.59 


H Public Relations 




Deleted 




I Dedication 


157 


6.79 


1.45 


J Overall Performancr 


204 


6.32 


1.62 


K Mean of AJI Ratings 


206 


6.65 


1.21 



Table 8 

Correlation Coefficients* (Based on Pair-Wise Deletion) Between Job Performance 
Rating Dimensions for Middle Uvel Officers With Both Test and Rating Information 

Dimension ABCDEF GHIJK 



A 


Administrative 
















B 


Communications 


50 














C 


Scheduling 


58 


49 












D 


Training 


51 


51 


45 .. 










E 


Supervision • 


48 


53. 


50 43 .. 






D 




F 


Subordinate Evaluation 


51 


57 


42 60 44 






e 




G 


Field Conunand 


46 


50 


47 51 43 


54 




1 




H 


Public Relations 






Deleted 






e* 




I 


Dedication 


37 


38 


44 39 41 


41 


45 


I 




J 


Overall Performance 


68 


58 


56 59 52 


64 


59 


e 


56 


K 


Mean of All Ratings 


78 


76 


•75 75 73 


77 


75 


d 


65 



*Decim«b omtni^ 
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APPENDIX D 

DECISION RULES USED I^OR DEVELOPING 
MODAL RESPONSE KEYS 
FOR 

INVENTORIES OF LIKES AND DSSLIKES 

AND 

SITUATIONAL JUDGMENT INVENTORIES 
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SCORING RULES FOR DEVELOPING MODAL RESPONSE KEYS 
FOR THE LIKES AND DISLIKES INVENTORIES 

The format has three sepan^te sections: (a) the regular LID format; (b) the dichotomous 
format; and, (c) the blocks of ten items where respondent chooses the three he likes best 
and the three he likes least. 

I. Here are the rules to be used for the format using blocks of ten: 

1. First examine each column of ten percentages. Score, the three items with the 
highest percentages under BEST as +1; score the three items with the highest 
percentages under LEAST as + 1; score the four items with highest percentages under 
DIDN'T MARK as +1. In case of ties, weight both items. 

2. Then examine response distributions for each row (i.e., each i(em) receiving 
scoring weights for BEST or LEAST. Give a v^eight of -1 to the response v/ith the 
jma//ejr percentage for each of these items. Dc n:) further weighting for those items 
with weights for the DIDN'T MARK response. 

II. Heie are rules for the iterhs with LID formats: 

1. Examine L and D responses for each item. If either response has 60 percent or 
more, weight it +1; weight 1 as 0 and the other end of t' ^ item as -1. 

Note that no Indifferent responses are to be weighted +: ; rj the basis of this rule 
alone. 

2. Examine the sum of the percentages for 1 and the larger oi in<:\ \ T>ercentage3 L 
or D. When the sum is 75 fx;rcene or greater, weight those two r>> i + 1 and (tic 
third response —1. Do not, ■ ■ * litems if the difference betwtta ? - J n percen- 
tages is 5 percent or less. 

III. Here are rules for items that an: dichotomies: 

1. ' If one response is 60 to 74 per .c;>v. score it +1, the other, 

2. If one response is 75 percenl or scoster, score it +1, the Uiv'y, —a, 

SCORING RULES FOR DEV^ilOP^NG MODAL RESFONSSE KEYS 
FOR SITUATIONAL JUDG^gNT INVENTORIES 

Here are decision rules for deveioping scoring keys for situational inventories for patrol 
officers, sergeants, detectives, and middle Icyel comniand people: 

1. The output gives the percentages of respondents who chose each response option a$ 
BEST for each item and the percentages who chose each response option £S WORST. 
Subtracting the sum of percentages for BEST and WORST from 100 for each option 
gives the percentage who did not choose the option for either category. Use !his **Not 
Used" choice g ; a basis for scoring along with i])e other choices of BEST and 
WORST. 

2. First, examine the ptircentages for each respon'?e option for the choice BEST. Focus on 
the two highest pcreenti^^^es. 

a. If the two highest perccata:.;es differ by no more than 19 percentage points, weight 
er-:!' of the corresponding response options +1. 

b. one percentage is 20 or more points larger than the other, weight the response 
iption corresponding to the larger percentage +2.arjtJ v-a^ response option corre- 
sponding to the sn^aller percentage + 1 , but if the smaller of the two percerttages is 
L sa (han 15, do not weight the corresponding response option at all. 

c. Aiso, if the third highest percentage differs by four percentage points, or less from 
nhe second highest percentage, then weight its correLponding response option +1 
too, 

3. Next, examine the percentages for each response option for the choice WORST, 
Again, focus on the two highest percentages, and fix scoring weights fof "respoiiSi; 
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optior^s according to the decision rules delineated above for 2b. '^'>v a?id 2c. 

4. Now that response options have been weighted according to step- ;siHj 3, give exactly 
opposite scoring weights to the response options for the opposite ' ^, .uce. For example: 

• If option 1 for a particular item had been given a weight oi f 2 for BEST, then 
give it a weight of -2 for WORST; similarly, if it had bcei> u^iwcn + 1 for BEST, 
then give it a weight of -1 for WORST, etc. 

• If option 2 for a particular item had been given a weight of 2 (or WORST, then 
give it a weight of -2 for BEST; similarly, if it had been given + 1 for WORST, 
then give it a weight of - 1 for BEST, etc. 

But note: 

These rules occasionally lead to conflicting ^vcights for a particular option for a 
particular choice. In these instances, remove oil scoring weights from the •'offend- 
ing" response options. The content of such items seem to involve .actions which 
may either be stated av^^biguously or for which conventional wisdom could argue for 
cither the BEST or WORST choice. They seem to represent ''poor" response 
options, and it makes good sense not to weight them.) 

5. Finally, examine the percentages for each response option for the ''Not Used" choice. 
Don't weight any response option with 64 percent or fewer choices. Give -fl to 
response options with **Not Used" percentages between 65 percent and 84 percent. 
Give +2 to response options with **Not Used" percentages of 85 percent or greater. 



APPENDIX E 

TABLES SHOWING NUMBERS OF WEIGHTED ITEMS, 
MEDIAN FOLDBACK AND CROSS-VALIDITIES FOR 
VARIOUS SCORING KEYS ACCORDING TO ITEM 
POOL AND CRITERION SCORE UMITS FOR EACH 
CRITERION DIMENSION AND EACH POLICE 
JOB FUNCTION 
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Table 1 

Number of Weighted items, Foldback Coefficients, and Median^Cross-Vaiidities for Scoring Keys, 
According to Type of Item Pool, and Criterion Limits 

for Criterion Dimension P-Crime for Patrolmen - - 



Criterion Limits for Non-Zero Scoring Weights 
48.0 and 52.0 48.5 and 51.5 49.0 and 51.0 

No. of Fokl' Mdn No. of Fold- Mdn No. of Fold- Mdn 

Items back C'V Items back CV Items back CV 



Bio Past 


615 


5 


.26 


.06 


12 


.32 


.08 


25 


.38 


.(19 


59 


.43 


.11 


Bio Mixed 


593 


10 


.32 


.14 


14 


. . 


.15 


29 


.36 


.17 


49 


.38 


.13 


Bio Total 


612 


13 


.36 


.14 


29 


.42 


.14 


56 


.46 


.16 


108 


.49 


.16 


Like-Dislike 


524 


17 


.34 


.15 


30 


.38 


.16 


52 


.43 


.19 








Siniational 


403 


23 


.41 


.01 


36 


.45 


,03 


54 


.50 


-.05 


95 


.54 


.01 


OSDl 1 


524 


1 


.12 


.05 


4 


.21 


.CO 


15 


.31 


.10 


41 


.35 


.11 


OSD12 


529 


0 


.00 


.11 


2 


.23 


.10 


9 


.33 


.13 


31 


.35 


.15 


OSDl 3 


529 


5 


.29 


.17 


13 


.32 


;i5 


30 


.34 


.16 


57 


.32 


.17 



Table 2 

Number of Weigrited Items, Foldback Coefficients, and Median Cross-Validities for Scoring Keys, 
According to Type of Item Pool, and Criterion Limits 
for Criterion Dimension P-Force for Patrolmen 



Number ^^-^ ^^'^ 

of No. of Fokl- Mdn 
Item Pool Persons Items back CV 



Criterion Limits for Non-Zero Scoring Weights 
Jqu^,^^J 47.5 and 52.5 48.0 and 52.0 48.5 and 51:5 49.0 and 51.0 

of No. of FoW- Mdn No. of FdW- Mdn No. of FoW- Mdn No. of Fold- Mdn 

Item Pool Persons Items back CV Items back CV Items back CV Items back CV 



Bio Past 


623 


5 


.17 . 


.05 


10 


.26 


.09 


29 


.32 


.13 


54 


.38 


.12 


Bio Mixed 


601 


8 


.28 


.16 


10 


.30 


.11 


21 


.36 


.12 


38 


.39 


.09 


Bio Toul 


620 


12 


.28 


.08 


19 


.33 


.09 


46 


.40 


.12 


94 


.47 


•14 


Like-Dislike 


528 


1 


.22 


.07 


18 


.33 


.07 


41 


.39 


.08 








Siniational 


410 


20 


.40 


.06 


39 


.48 


.10 


63 


.53 


.06 


99 


.61 


.12 


OSDl 1 


531 


1 


.15 


.02 


5 


.22 


.03 


13 


.31 


.09 


43 


.39 


.11 


OSDl 2 


536 


0 


.00 


.01 


1 


.15 


.04 


5 


.26 


.07 


26 


.37 


.13 


OSDl 3 


536 


6 


.23 


.17 


13 


.27 


.18 


22 


.32 


.15 


45 


.34 


.12 



Table 3 

Number of Weighted Items, Foldback Coefficients, and Median Cross-Validities for Scoring Keys, 
According to Type of Item Pool, and Criterion Limits 
for Criterion Dimension P-Teamwork for Patrolmen 



Criterion '.Units for Non-Zero Scoring Weights 





Number 


47.5 and 52.5 




48.0 and 52.0 




48.5 and 51.5 




49.0 and 51.0 






of 


No. of 


Fokl- 


Mdn 


No. of 




Mdr 


No. of 


FoSd- 


Mdn 


No. of 


Fokl- 


Mdn 


I'^em Pool 


Persons 


Items 


back 


CV 


Items 


back 


CV 


Items 


beck 


CV 


Items 


back 


CV 


Bio Past 


517 


7 


.31 


.10 


17 


.34 


.09 


34 


.38 


.13 


49 


.41 


.11 


Bio Mixed 


498 


9 


.31 


.15 


18 


^ .38 


.16 


35 


.41 


.18 


59 


.43 


.22 


Bio Total 


515 


16 


40 


.15 


35 


.41 


.19 


70 


.47 


.21 


108 


.51 


.17 


Like-Dislike 


445 


19 


.40 


.19 


33 


.44 


.24 


60 


.51 


.23 








Siniationa] 


308 


42 


.50 


-.00 


58 


.53 


.05 


80 


.60 


.04 


115 


.61 


.03 


OSDl 1 


441 


7 


.28 


15 


10 


.32 


.14 


20 


.39 


.14 


51 


.46 


.13 


OSDl 2 


443 


0 


.00 


.05 


4 


.24 


.09 


16 


.36 


.12' 


42 


-:42 


.16 


OSDl 3 


443 


12 


.33 


.17 


29 


.34 


.17 


50 


.33 


.21 


84 


.35 


.22 



187 



173 



TAfcLE 4 



Number of Weighted Items, Foldback Coefficients, and Median Cross-Validities for Scoring Keys, 
According to Type of Jtem^Pool, and Criterion Limits 
for Criterion DimensiQi^ P-Overall for Patrolmen 



Criterion Limits for Non-Zero Scoring Weights 

^ 47.5 and 52.5 48.0 and 52.0 48.5 and 51.5 49.0 and 51.0 
Number 





of 


No. of 


Fold- 


Mdn 


No. of 


Fold- 


Mdn 


No. of 


Fold- 


Mdn 


No. of 


Fold- 


' Mdn 


Item Pool 


Persons 


Items 


back 


CV 


Items 


back 


CV 


Items 


back 


CV 


Items 


back 


CV 


Bio Past 


696 


5 


.27 


.10 


12 


.33 


.11 


21 


.35 


.12 


46 


.39 


.12 


Bio Mixed 


674 


12 


.32 


.17 


21 


.37 


.22 


32 


.40 


.23 


48 


.41 


.22 


Bio Total 


693 


16 


.36 


.17 


32 


.42 


.20 


50 


.45 


.23 


95 


.48 


" .24 


Like- Dislike 


592 


18 


.40 


.20 


30 


.41 


.22 


46 


.43 


.22 


90 


.46 


.22 


Situational 


482 


18 


.40 


.11 


43 


.50 


.10 


64 


.54 


.17 


92 


.55 


.13 


OSDI 1 


593 


3 


.20 


-.00 


6 


.22 


.15 


18 


.35 


.18 


44, 


.39 


.23 


OSDI 2 


600 


2 


.23 


.15 


2 


.23 


.17 


21 


.30 


.21 




.37 


.23 


OSDI 3 


600 


10 


.30 


.20 


21 


.33 


.22 


43 


.29 


.19 


68-^ 


.29 


.23 



Table 5 

Number of Weighted Items, Foldback Coefficients, and Median Cross-Validities for Scoring Keys, 
According to Type of Item Pool, and Criterion Umits 
for Criterion Dimension P-Random for Patrolmen 



Criterion Limits for Non-Zero Scoring Weights 





Number 


47.5 and 52.5 




48.0 and 52.0 




48.5 and 51.5 




49.0 and 5 1.0 






of 


No. of 


Fold- 


Mdn 


No. of 


Fold- 


Mdn 


No. of 


Fold- 


Mdn . 


No. of 


Fold- 


Mdn 


Item Pool 


Persons 


Items 


back 


CV 


Items 


back 


CV 


Items 


back 


CV 


Items 


back 


CV 


Bio Taut 


696 


2 


.11 


-.02 


4 


.15 


.04 


18 


.31 


.07 


37 


.38 


.04 


Bio Mixed 


674 


1 


.09 


-.01 


4 


.18 


.02 


15 


.28 


.01 


36 


.34 


.02 


Bio Total 


693 


3 


.14 


-.01 


7 


.19 


.01 


30 


.37 


.02 


69 


.44 


.05 


Like-Dislike 


592 


3 


.17 


-.01 


8 


.24 


.01 


23 


.36 


.03 








Situational 


482 


11 


.32 


-.03 


23 


.39 


.00 


49 


.46 


-.03 


90 


.55 


.03 


OSDI 1 


593 


0 


.00 


-.04 


1 


.08 


.04 


6 


.20 


-.20 


22 


.29 


-.04 


OSDI 2 


600 


0 


.00 


.00 


0 


.00 


.08 


3 


.19 


.04 


9 


.26 


-.00 


OSDI 5 


600 


0 


.00 


.00 


4 


.22 


.05 


12 


.28 


.03 


32 


.35 


.03 



Table 6 

Number oj Weighted Items, Foldback Coefficients, and Median Cross-Validities for Scoring Keys, 
According to Type of the Item Pool, and Criterion Limits 
for Criterion Dimension D-Investigate for Detectives 



Criterion Limits for Non-Zero Scoring Weights 

^ 47.5 and 52.5 48.0 and 52.0 48.5 and 51.5 49.0 and 51.0 

Number 





of 


No. of 


Fold- 


Mdn 


No. of 


Fold- 


Mdn 


No. of 


Fold- 


Mdn 


No. of 


Fold- 


Mdn 


Item Pool 


Persons 


Items 


back 


CV 


Items 


back 


CV 


Items 


back 


CV 


Items 


back 


CV 


Bio Past 


377 


16 


.38 


.03 


20 


.41 


.09 


38 


.48 


.05 


65 


.52 


.04 


Bio Mixed 


363 


13 


.38 


.09 


22 


.45 


.08 


37 


.50 


.12 


64 


.56 


.14 


Bio Total 


374 


29 


.45 


.11 


38 


.51 


.09 


69 


.57 


.20 


131 


.61 


.18 


Like-Dislike 


304 


20 


.38 


.10 


40 


.47 . 


.11 


69 


.50 


.12 








Situational 


359 


29 


.46 


.10 


49 


.55 


.06 


79 


.62 


.07 


116 


.63 


.11 


OSDI 1 


218 


11 


.36 


.65 


.^21 


.44 


.06 


40 


.53 


.05 


62 


.57 


.05 


OSDI 2 


296 


0 


.00 


.00 


3 ' 


.23 


-.07 


9 


.32 


-.01 


28 . 


.41 


.00 ^ 


OSDI 3 


296 


8 


.27 


.07 


16 


.34 


.03 


30 


.42 


-.00 


55 ' 


.44 


•09 



174 



188 



X\r*x,E 7 



Number of Weighted Items, Foldback Coefficients, and Median Cross-Validities for Scoring Keys, 
According to Type of Item Pool, and Criterion Limits 
for Criterion Dimension D-Integrity for Detectives 



Criterion Limits for Non-Zero Scoring Weights 





Number 


47.5 and 52.5 




48.0 and 52.0 




48.5 and 51.5 




49.0 and 51.0 






of 


No. of 


Fold- 


Mdo 


No. of 


Fold- 


Mdn 


No. of 


Fold. 


Mdn 


No. of 


Fold- 


Mdn 


Item Pool 


Persons 


Items 


back 


CV 


Items 


back 


CV 


Items 


back. 


CV 


Items 


back 


CV 


Bio Past 


214 


27 


.55 


.15 


42 


.55 


.17 


62 


.56 


.19 


85 


.59 


.12 


Bio Mixed 


205 


20 


.45 


-.04 


32 


.56 


-.06 


49 


.64 


.02 


70 


.63 


.04 


Bio Total 


212 


47 


.65 


.09 


73 


.66 


.10 


115 


.70 


.17 . 


156 


.70 


.16 


Like- Dislike 


175 


31 


.46 


-.08 


53 


.57 


-.01 


-96 


.63 


.02 








Situational 


203 


64 


.64 


.16 


84 


.71 


.12 


108 


.71 


.18 


140 


.70 


.17 


OSDI 1 


154 


11 


.42 


.08 


29 


.55 


.00 


48 


.61 


.10 


95 


.69 


.12 


OSDI 2 


186 


7 


.41 


.16 


14 


.46 


.12 


28 


.53 


.06 


56 


.59 


.08 


OSDI 3 


186 


17 


.42 


.13 


33 


.48 


.09 


58 


.48 


.11 


77 


.48 


.12 



Table 8 

Number of Weighted Items, Foldback Coefficients, and Median Cross-Validities for Scoring Keys, 
According to Type of Item Pool, and Criterion Limits 
for Criterion Dimension D-Reporting for Detectives 



Criterion Limits for Non-Zero Scoring Weights 





Number 


47.5 and 52.5 




48.0 and 52.0 




48.5 and 51.5 




49.0 and 51.0 






of 


No. of 


Fokl- 


Mdn 


No. of 


FoW- 


Mdn 


No. of 


Fold- 


Mdn 


No. of 


Fold- 


Mdn 


Item Pool 


Persons 


Items 


back 


CV 


'Items 


back 


CV 


Items 


back 


CV 


Items 


back ' 


CV 


Bio Past 


233 


24 


.56 


.11 


34 


.57 


.11 


49 


.60 


.08 


67 


.61 


.05 


Bio Mixed 


227 


28 


.53 


.18 


38 


.57 


.20 


52 


.62 


.25 


73 


.61 


.24 


Bio Total 


232 


50 


.64 


.21 


69 


.65 


.22 


100 


.72 


.23 


146 


.70 


.25 


Like-Dislike 


196 


30 


.56 


.15 


57 


.57 


.12 


85 


.63 


.14 








Situational 


227 


45 


.58 


.06 


66 


.61 


.04 


97 


.65 


.08 


122 


.64 


.12 


OSDI 1 


103 


21 


.66 


-.06 


39 


.68 


-.06 


63 


.73 


-.02 


88 


.75 


-.04 


OSDI 2 


180 


3 


.34 


.01 


10 


.43 


.03 


26 


.54 


-.01 


57 


.53 


.03 


OSDI 3 


180 


22 


.52 


.04 


29 


.56 




51 


.57 


.08 


75 


.57 


.12 



Table 9 

Number of Weighted Items, Foldback Coefficients, and Median Cross-Validities for Scoring Keys, 
According to Type of Item Pool, and Criterion Limits 
for Criterion Dimension D-Overallfor Detectives 



Criterion Limits for Non-Zero Scoring Weights 

^, ^ 47.5 and 52.5 48.0 and 52.0 48.5 and 51.5 49.0 and 51.0 
Number — 





of 


No. of 


Fold- 


Mdn 


No. of 


FoU- 


Mdn 


No. of 


Fold- 


Mdn 


No. of 


..^ Fold- 


Mdn 


Item Pool 


Persons 


Items 


back 


CV 


Items 


back 


CV 


Items 


back 


CV 


Items 


back 


CV 


Bio Past 


415 


19 


.36 


.05 


25 


.41 


.10 


32 


.46 


.09 


57 


.51 


.09 


Bio Mixed 


398 


14- 


.39 


.17 


25 


.46 


.25 


40 


.54 


.20 


62 


.58 


.26 


Bio Total 


412 


35 


.47 


.22 


52 


.52 


.16 


73 


.56 


.19 


114 


.61 


.22 


Like-Dislike 


328 


19 


.41 


.04 


30 


.48 


.07 


49 


.52 


.08 








Situational 


394 


32 


.50 


.16 


56 


.55 


.17 


75 


.59 


.13 


101 


.62 


: .17 


OSDI 1 


249 


5 


.29 


.04 


15 


.35 


-.01 




.43 


.02 


61 


.52 


.04 


OSDI 2 


. 329 ' 


0 


.00 


.00 


2 


.21 


.06 


8.' 


.32. 


.02 


25 


.39 


-.05 


OSDI 3 


329 


3 


.21 


.02 


12 


.29 


.02 


32 


.36 


.02 


58 


.39 


.01 



189 



!75 



Table 10 



Number of Weighted Items, Foldback Coefficients, and Median Cross-Validities for Scoring Keys, 
According to Type of Item Pool, and Criterion Limits 
for Criterion Dimension D-Random for Detectives 



Criterion Limits for Non-Zero Scoring Weights 



Item Pool 


Number 

of 
Persons 


47.5 and 52.5 

No. of Fold- 
Items back 


Mdn 
CV 


48.0 and 52.0 

No. of FoU- 
Items back 


Mdn 
CV 


48.S and 51.5 

No. of FoW- 
Items back 


Mdn 
CV 


49.0 and 51.0 

No. of Fokl- 
Items back 


Mdn 
CV 


Bio Past 


415 


7 


.24 


-.00 


17 


.31 


-.05 


27 


.36 


-.02 


52 


.44 


.01 


Bio Mi!;ed. 


398 


8 


.28 


.00 


13 


.35 


-.03 


24 


.40 


.02 


49 


.48 


-.01 


Bio Total 


412 


16 


.38 


.04 


32 


.43 


.02 


53 


.48 


.00 


102 


.57 


-.02 


Uke-Dislike 


328 


12^ 


.36 


-.03 


20 


.38 


-.04 


54 


.48 


-.03 








Situational 


394 


15 


.34 


-.08 


25 


.38 


-.11 


55 


.48 


-.11 


96 


.53 


-.09 


OSDl 1 


249 


12. 


.37 


.13 


20 


.38 


.08 


31 


.44 


.05 


61 


.49 


.06 


OSDl 2 


329 


0 


.00 


.00 


0 


.00 


.00 


5 


.27 


-.05 


20 


.36 


-.05 


OSDl 3 


329 


2 


.19 


.03 


10 


.33 


-.01 


20 


.41 


.03 


47 


.48 . 


-.02 



Table 1 1 

Number of Weighted Items, Foldback Coefficients, and Median Cross-Validities for Scoring Keys, 
According to Type of Item Pool, and Criterion Limits 
for Criterion Dimension S-Training for Sergeants 



Cri .crion Limits fo^- Non-Zero Scoring Weights 





Number 


47 


.5 and 52.5 




^*8 


.0 and 52.0 




48 


.5 and 51.5 




. 49 


.0 and 51.0 






of 


No. of 


Fokl- 


Mdn 


No. i f 


FoU- 


Mdn 


No. of 


Fokl- 


Mdn 


No. of 


Fold-. 


Mdn 


Item Pool 


Persons 


Items 


back 


CV 


Itemi 


back 


CV 


Items 


back 


CV 


Items 


back 


CV 


Bio Past 


362 


12 


.36 


.07 


23 


.41 


.35 


46 


.49 


.16 


61 


.52 


.11 


Bio Mixed 


357 


16 


.39 


.14 




.46 


.28 


41 


.53 


.14 


67 


.54 


.18 


Bio Total 


362 


29 


.47 


.13 


4i 


.52 


.19 


89 


.60 


.19 


126 


.61 


.18 


Like- Dislike 


311 


16 


.33 


.01 


^ ... :a 


.36 


.01 


50 


.39 


-.04 








Situational . 


353 


40 


.55 


.10 


57 


.60 


.08 


77 


.60 


.07 


104 


.60 


.11 


OSDl 1 


280 


10 


.43 


.09 


13 


.43 


.08 


,24 


.51 


.02 


54 


.54 


.05 


OSDl 2 


338 


1 


.17 


.07 


5 


.33 


.10 


16 


.38 


.12 


38 


.42 


.09 


OSDl 3 


338 


13 


.32 


.10 


17 


.31 


.09 


34 


.33 


.09 


51 


.35 


.05 



Table 12 

Number of Weighted Items, Foldback Coefficients, and Median Cross-Validities for Scoring Keys, 
According to Type of Item Pool, and Criterion Limits 
for Criterion Dimension S-Supervision for Sergeants 



Criterion Limits for Non-Zero Scoring Weights 
47.5 and 52.5 48.0 and 52.0 48.5 and 51.5 49.0 and 51.0 





of 


No. of 


FoW- 


Mdn 


No. of 


FoU* 


Mdn 


No. of 


FoM- 


Mdn 


No. of 


FoM. 


Mdn 


Item Pool 


Persons 


Items 


back 


CV 


Items 


back 


CV 


Items 


back 


CV 


Items 


back 


CV 


Bio Past 


358 


15 


.40 


.09 


27 


.48 


.06 


42 


.53 


.08 


64 


.57 


.12 


Bio Mixed 


353 


14 


.38 


.09 


21 


.44 


.11 


34 


.51 


.07 


47 


.54 


.03 


Bio Total 


358 


29 


.51 


.11 


48 


.60 


.09 


77 


.65 


.09 


116 


.66 


.08 


Like-Dislike 


307 


18 


.41 


.06 


32 


.44 


.05 


50 


.49 


-.01 








Situational 


349 


30 


.50 


.09 


54 


.56 


.06 


78 


.61 


. .13 


112 


.64 


.10 


OSDl 1 


278 


10 


.41 


.08 


19 


.48 


.07 


28 


.52 


.08 


32 


.57 


.07 


OSDl 2 


335 


0 


.00 


.03 


4 


.25 


.07 


14 


.39 


.06 


30 


.45^ 


.09 


OSDl 3 


335 


5 


.29 


-.01 


10 


.36 


-.03 


22 


.37 


-.03 


51 


.48 


-.02 



176 



190 



Table 13 



Number of Weighted Ittms\ Foldback Coefficients, and Median Cross-Validities for Scoring Keys. 
According to Type of Item Pool, and Criterion Limits 
for Criterion Dimension S-lnspection for Sergeants 



Criterion Limits for Non-Zero Scoring Weights 
47 .5 and 52.5 4 8.0 and 52.0 48.5 and 51.5 49.0 and 51.0 





of 


No. of 


Fold- 


Mdn 


No. of 


Fold- 


Mdn 


No. of 


Fold- 


Mdn 


No. of 


Fold- 


Mdn 


Item Pool 


Persons 


Items 


back 


CV 


Items 


back 


CV 


Items 


back 


CV 


Items 


back 


CV 


Bio Past 


283 


16 


.43 


-,03 


25 


.50 


.01 


41 


.54 


.05 


66 


.59 


.06 


Bio Mixed 


278 


19 


.51 


.16 


29 


.54 


.15 


37 


.56 


.15 


67 


.61 


.10 


Bio Total 


283 


37 


.6! 


.09 


51 


.67 


.14 


80 


.69 


.10 


132 


.72 


.10 


Like-Dislike 


245 


24 


.46 


.08 


38 


.51 


.05 


61 


.56 


.01 








Situational 


275 


43 


.60 


.09 


58 


.62 


.08 


77 


.61 


.06 


108 


.64 


.05 


OSDl i 


202 


14 


.47 


.07 


19 


.49 


.11 


35 


.59 


-.01 


72 


.65 


.06 


OSDl 2 


259 


4 


.29 


.09 


6 


.34 


.01 


15 


.43 


.08 


35 


.49 


.04 


OSDl 3 


259 


7 


.29 


.06 


17 


38 


.02 


31 


.43 


-.00 


64 


.51 


.00 



Table 14 

Number of Weighted Items, Foldback Coefficients, and Median Cross-Validities for Scoring Keys, 
According to Type of Item Pool, and Criterion Limits 
for Criterion Dimension S-Overallfor Sergeants 



Criterion Limits for Non-Zero Scoring Weights 
47.5 and 52.5 48.0 and 52.0 48,5 and 51.5 49.0 and 51.0 





of 


No. of 


Fold- 


Mdn 


No. of 


FoW- 


Mdn 


No. of 


Fold- 


Mdn 


No. of. 


i:old. 


Mdn 


Item Pool 


Persons 


Items 


back 


CV 


Items 


back 


CV 


Items 


back 


CV 


Items 


back 


CV 


Bio Past 


361 


13 


.39 


.10 


19 


.45 


.08 


40 


.52 


.12 


^8 


.55 


.10 


Bio Mixed 


356 


13 


.42 


.13 


22 


.47 


.12 


39 


.52 


.09 


62 


.52 


.08 


Bio Total 


361 


28 


.53 


.14 


39 


.58 


.17 


76 


.63 


* .13 


129 


.64 


.12 


LiKe-Dislike 


310 


10 


.32 


-.03 


21 


.37 


-.05 


38 


.40 


-.01 








Situational 


352 


39 


.51 


.10 


52 


.59 


.08 


84 


.61 


.17 


114 


.62 


.12. 


OSDl 1 


278 


5 


.30 


-.00 


14 


.41 


.05 


35 


.56 


.09 


63 


.59 


.10 


OSDl 2 


336 


0 


.00 


-.02 


5 


.27 


.02 


7 


.33 


.06 


35 


.44 . 


.02 


OSDl 3 


336 


6 


.25 


.02 


16 


.27 


.07 


28 


.30 


,04 


56 


.35 


.03 



Table 15 

Number of Weighted Items, Foldback Coefficients, and Median Cross-Validities for Scoring Keys, 
According to Type of item Pool, and Criterion Limits 
for Criterion Dimension S-Random for Sergeants 



"^'^ L ^ Criterion Limits for Non-Zero Scoring Weights 
47.5 and 52:^'*'^ 48.0 and 52.0 48.5 and 51.5 49.0 and 51.0 



Item Pool 


of 
Persons 


No. of 
Itc;ns 


Fold- 
back 


Mdn 
CV 


No. of 
Items 


FoW- 
back 


Mdn 
CV 


No. of 
Items 


Fold- 
back 


Mdn 
CV 


No. of 
Items 


Fold- 
back 


Mdn 
CV 


Bio Past 


361 


5 


.27 


-.02 


13 


.36 


-.02 


32 


.46 


.02 


61 


.48 


-.02 


Bio Mixed 


356 


12 


.34 


.00 


22 


.42 


.07 


42 


.49 


.04 


64 


.55 


09 


Bio Total 


361 


18 


.41 


.06 


35 


.52 


.05 


74 


.61 


.07 


126 


.65 


.01 


Like-Dislike 


310 


8 


.28 * 


.01 


21 


.38 


-.01 


46 


.46 


-.04 








Situational 


352 


18 


.41 


-.06 


36 


.49 


-.02 


65 


.58 


-.04 


101 


.63 


-.02 


osoi 1 


278 


8 


.37 


.11 


14 


.45 


.09 


35 


.48 


.14 


60 


.51 


.13 


OSDl 2 


336 


0 


.00 


-.01 


2 


.23 


.04 


12 


.35 


.08 


35 


.41 


.02 


OSDl 3 


336 


2 


.17 


-.08 


5 


.24 


.00 


26 


.31 


.00 


45 


.32 


-.01 



191 



177 



Table 16 

Number of Weighted Items, Foldback Coefficients, and Median Cross-Validities for Scoring Keys, 
According to Type of Item Pool, and Criterion Limits 
for Criterion Dimension C -Administration for Middle Command 



Crit;;rion Limits for Non-Zero Scoring Weights 

Numbc' 47. 5 and 52.5 48.0 and 52.0 48.5 and 5L5 49.0 and 5L0 

of . No. of Fold- Mdn No, of Fold- Mdn No. of Fold- Mdn No. of Fold- Mdn 

Item Pool Persons Items back CV Items back CV Items back CV Items back CV 



Bio Past 


204 


29 


.51 


.09 


40 


.56 


.15 


57 


.08 


.07 


79 


.59 


.19 


Bio Mixed 


200 


19 


.51 


.16 


32 


.59 


.17 


53 


.57 


.11 


78 


.61 


.14 


Bio Total 


204 


50 


.66 


.15 


74 


.69 


.16 


109 


.70 


.21 


152 


.73 


.24 


Like-Dislike 


186 


35 


.60 


.07 


54 


.55 


.06 


75 


.57 


.05 








Situational 


200 


56 


.62 


;12 


74 


.66 


.08 


105 


.67 


.10 


128 


.69 


.15 


OSDI 1 


164 




.48 


-.04 


18 


.55 


-.01 


37 


.58 


-.03 


72 


.04 


-.04 


OSDI 2 


197 


7 


.35 


.06 


13 


.42 


.07 


26 


.47 


.06 


54 


.51 


.11 


OSDI 3 


197 


28 


.55 


.21 


41 


.59 


.23 


. 56 


.62 


.16 


75 


.61 


.26 



Table 17 

Number of Weighted Items, Foldback Coefficietits, and. Median Cross-Validities for Scoring Keys, 
According to Type of Item Pool, and Criterion Limits 
for Criterion Dimension C-Communications for Middle Command 



Criterion Limits for Non-Zero Scoring Weights 
48.0 and 52.0 48.5 and 51.5 49.0 and 51.0 

No. of Fold- Mdn No. of Fold- Mdn No. of Fold- Mdn 

Items back CV items back CV Items back CV 



Bio Past 


183 


29 . 


.56 


.15 


45 


.60 


.08 


63 


.64 


.09 


78 


.63 


.06 


Bio Mixed 


182 


23 


.52 


.07 


33 


.60 


.12 


51 


.59 


.07 


73 


.59 


.08 


Bio Total 


186 


53 


.67 


.14 


78 


.73 


.12 


113 


.72 


.06 


152 


.71 


.05 


Like-Dislike 


169 


29 


.58 


.02 


48 


.66 


.05 


71 


.66 


.05 








Situational 


182 


€r 


.64 


.03 


87 


.66 


.11 


103 


.65 


.05 


128 


.65 


.07 


OSDI : 


147 


16 


.51 


.04 


24 


.59 


.08 


41 


.61 


.06 


70 


.64 


.07 


OSDI 2 


180 


6 


.34 


-.03 


14 


.43 


.07 


33 


.48 


.01 


63 


.51 


.07 


OSDI 3 


180 


20 


.52 


.17 


. 34 


.54 


.09 


55 


.56 


.09 


.75 


.55 


.11 



Table f8 

- Number of Weighted Items, Foldback Coefficients, and Median Cross-Validities for Scoring Keys, 
According to Type of Item Pool, and Criterion Limits 
for Criterion Dimension C-Personnel for Middle Command 



Criterion Limits for Non-Zero Scoring Weights 
47.5 and 52.5 48.0 and 52.0 48.5 and 51.5 49.0 and 51.0 





of 


No. of 


Fold- 


Mdn 


No. of 


Fold- 


Mdn 


No. of 


Fold- 


Mdn 


No. of 


Fold- 


Mdn 


Item Pool 


Persons 


Items 


back 


CV 


Items 


Dack 


CV 


Items 


back 


CV 


Items 


back 


CV 


Bio Past 


186 


22 


.47 


-.03 


40 


.57 


-.05 


59 


.59 


.00 


77 


.64 


-.03 


Bio Mixed 


182 


30 


.58 


.10 


39 


..59 


.10 


i54 


.59 


.11 


74 


.63 


.19 


Bio Total 


186 


48 


.66 


.09 


79 


.71 


.08 


110 


.71 


.15 


Ifjl 


.72 


.09 


Like-Dislike 


169 


29 


.53 


-.01 


55 


.64 


-.01 


.86 


.68 


.01 








Situational 


182 


65 


.68 


.10 


84 


.68 


.17 


109 


.73 


.11 


133 


.74 


.14 


OSDI 1 


147 


25 


.59 


.05 


39 


.62 


.11 


65 


.70 


.11 


91 


.71 


.10 


OSDI 2 


180 


6 ' 


.31 


.05 


16 


.42 


.01 


28 


.44 


.04 


55 


.53 


.01 


OSDI 3 


180 


23 


.53 


.08 


34 


.54 


.13 


49 


.57 


.12 


68 


.55 


.32 



178 



Number 47Jj5nd52J 
of No. of Fold- Mdn 
Hem Pool Persons Items back CV 



192 



Table 19 



Number of Weighted items, Foldback Coefficient s» and Median Cross-Validities for Scoring Keys, 
According to Type of Item Pool, and Criterion Limits 
for Criterion Dimension C-Dedication for Middle Command 



' Crilerioa Limits for 'Non-Zero Scoring Weights * 
47.5 and 52.5 48.0 and 52.0 48.5 and 51.5 49.0 and 51.0 





of 


No. of 


Fold- 


Mdn 


No, of 


Fold- 


Mdn 


No. of 


Fold- 


Mdn 


No. of 


Fold- 


Mdn 


Item Pool 


Persons 


Items 


back 


CV 


Items 


back 


CV 


Items 


back 


CV 


Items 


back 


CV 


Bio Past 


157 


31 


.62 


.10 


44 


.65 


.09 


57 


.68 


.11 


78 


.68 


-.00 


Bio Mixed 


155 


34 


.64 


.19 


42 


.64 


.27 


57 


.66 


.25 


73 


.66 


.31 


Bio Total 


157 


65 


.71 


.26 


90 


.76 


.30 


116 


.78 


.26 


148 


.79 


.24 


Likc-Disltke 


144 


37 


.59 


-.03 


54 


.67 


-.04 


82 


.71 


.07 








Situational 


155 


72 


.65 


.12 


87 


.65 


.17 


104 


.66 


.15 


130 


.68 


.13 


OSDI 1 


120 


26 


.62 


.14 


43 


.6^ 


.09 


61 


.70 


.14 


109 


.72 


.12 


0SDI2 


151 


9 


.44 


-.03 


14 


M 


.06 


36 


.61 


.00 


62 


.64 


.03 


OSDI 3 


151 


19 


.48 


.00 


33 


AS 


.03 


47 


.50 


.00 


65 


.53 


-.01 



Table 20 

Number oj Weighted Items, Foldback Coefficients, and Median Cross-Validities for Scoring Keys, 
According to Type of Item Pool, and Criterion Limits 
for Criterion Dimension C-Overall for Middle Command 



Criterion Limits fojJSon^ro Scoring Weights 





Number 


47.5 and 52.5 




48.0 and 52.0 


->.<^ 


48.5 and 51.5 




49.0 and 51.0 






of 


No. of 


Fold- 


Mdn 


No. of 


Fold- 


Mdn 


No. of 


Fold- 


Mdn 


No. of 


Fold- 


Mdn 


Item Pool 


Persons 


Items 


back 


CV 


Items 


back 


CV 


Items 


back 


CV 


Items 


back 


CV 


Bio Past 


206 


28 


.57 


.13 


41 


.61 


.15 


57 


.62 


.14 


83 


.64 


.16 


Bio Mixed 


202 


26 


.51 


.13 


39 


.56 


.22 


59 


.58 


.24 


79 


.61 


.20 


Bio Total 


206 


50 


.67 


.16 


75 


.70 


.26 


114 


.69 


.30 


161 


.71 


.34 


Like- Dislike 


188 


41 


.58 


.16 


59 


.54 


.17 


78 


.60 










Sitnitiona] 


202 


58 


.60 


.19 


77 


.61 


.33 


104 


.67 


.18 


123 


.69 


.23 


OSDI 1 


166 


14 


.47 


.02 


23 


.53 


.00 


48 


.56 


.06 


80 


.62 


:o6 


OSDI 2 


199 


7 


.36 


.05 


16 


.46 


.12 


33 


.50 


.18 


62 


.52 


.07 


OSDI 3 


199 


28 


.54 


.21 


37 


.56 


.26 


49 


.57 


.12 


71 


.58 


.17 



Table 21 

Number of Weighted Items, Foldback Coefficients, and Median Cross- Validities for Scoring Keys, According to Type 
of Item Pool, and Criterion Limits for Criterion Dimension C-Randomfor Middle Command 



Criterion Limits for Non-21ero Scoring Weights 
47.5 and 52.5 48.0 and 52.0 48.5 and 51.5 49.0 and 51.0 





of 


No. of 


Fold- 


Mdn 


No. of 


Fold- 


Mdn 


No. of 


Fold- 


Mdn 


No. of 


Fold- 


Mdn 


Item Pool 


Persons 


Items 


back 


CV 


Items 


back 


CV 


Items. 


back 


CV 


Items 


back 


CV 


Bio Past 


206 


30 


.54 


.07 


40 


.55 


.05 


52 


.54 


.02 


71 


.58 


.06 


Bio Mixed 


202 


19 


.54 


.06 


28 


.58 


.02 


43 


.63 


-.03 


67 


.61 


-.02 


Bio Total 


206 


50 


.65 


.11 


69 


.68 


.04 


95 


.69 


.03 


136 


.72 


.04 


Like-Dislike 


188 


25 


.55 


.06 


42 


.59 


.05 


71 


.66 


.04 








Situational 


202 


'43 


.63 


-.03 


62 


.65 


-.07 


S4 


.69 


-.05 


107 


.74 


-.02 


OSDI 1 


166 


9 


.36 


-.21 


15 


.42 


-.22 


32 


.54 


-.20 


67 


.61 


-.22 


OSDI 2 


199 


3 


.26 


-.07 


5 


.30 


-.10 


18 


.44 


-.12 


41 


.49 


-.11 


OSDI 3 


199 


7 


:29^ 


-.10 


19 


.33 


-.14 


36 


.47 


-.16 


64 


.52 


-.11 
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APPENDIX F 

TECHNICAL NOTE: 
PROCEDURE USED FOR ESTIMATING 
EXPECTED CROSS-VALIDITY COEFFICIENTS 
FOR FINAL PREDICTOR SCALES 
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Primarily for convenience in reporting, an approach was conceived for estimating the 
cross-validity of composite predictors formed by weighting two or more predictor vari- 
ables when each was validated separately from the others. Although no claims of superior 
characteristics of the estimators are made, it is felt that they are based upon an acceptable 
rationale and lead to uninflated estima^^s. 
Two types of problems presented themselves: 

1 . The predictor variables were separately validated with respect to the same criterion 
variable. 

2. The predictor variables were each validated with respect to different (but correlated) 
criterion variables. 

As shall be seen, the first of the two is a special case of the second. 
Definitions 

Let p be a linear composite of m predictor scores for any one person: 

p = v,X, + V2X2 + . . , + VmXrn 

where Xi (i = 1, 2, . . . , m) is the "z-score'* on the i^** predictor and Vj is the assigned 
weight. Then, let z be a linear composite of n criterion scores for the same person: 

z = w,y, + w^y. + . , . + w„y„ 

where yi (i = 1, 2, . . . , n) is a "'z-score** for the i"* criterion and Wi is the assigned 
weight. By ''z-score** it is meant that the score is expressed in terms of a transformation to 
a mean of zero and variance of one. 

The value to be estimated is the *'true** correlation between p and z: 

„ Cov (p, z) 

KPZ ~ !5- 

[Var (p) Var (z)] 

where Cov (p, z) denotes the covariance ofp andz and Var (x) denotes the variance of x. 



It can be shown that: 



Ppz = 



m n 

2 2 ViWj Pxjy. 

i=l j=l 



r/ m m \ / n n \"j 

[2 2 VlVj PxiXj J 2 2 WiWj Py y ] 

where p^jyj is the "true** correlation between the i*** predictor and the j*** criterion, Pxpcj» 
is the "true** intercorrelation between the i"* and j*** predictors, and py^y^ is the 
"true" inlercorrelation between the i"* and j*** criteria. 

Estimation of cross-validity: single criterion variable ' 

Only sample statistics are available for the estimation of the cross-validities.^ For the case 
of a single criterion (n = 1), the following substitutions were made in the estimate of 
cross-validity, Pp2, after simplification allowed by the single criterion: 



Ppz ~ 



m 

2 vi pxjy 
i=l 




where p^j^j is the Pearsonian coefficient computed between predictors in the develop- 



mental sample and Px^y is the cross-validity estimate obtained in the Monte Carlo 
cross-validation procedure for the i"* predictor with respect to the common criterion 
variable. 

Estimation of cross-validity: multiple criteria 

Again, the available sample statistics were substituted in order to obtain the single 
estimate of cross-validity for the case of n> 1 : 

m n 

2 X VjWiPxjyj 

i=l j=l 



Km m \ /n n \1 ^ 



Ppc 



where, as before, p^jxj is the Pearsonian coefficient between predictors in the develop- 
mental sample and py^y^ is the Pearsonian coefficient between criterion variables in the 
sample. 

The special problem of multiple criteria is found in the values to be used for px,y^ be- 
cause all combinations of p<edictors and criteria were not cross-validated through the 
Monte Carlo cross-validation procedure. In fact» any one predictor was cross-validated 
with respect to only one of the n criteria. 

To fill in the missing values, the assumpti(H] of equal cross-validities was made so that the 
cross- validity obtained for a particular predictor was substituted as the estimate of validity 
for every criterion. 
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APPENDIX G 



ITEM SAMPLES AND ILLUSTRATIVE 
SCORING WEIGHTS FOR CAREER INDEX 
PREDICTOR SCALES 
FOR 

PATROL OFFICERS 
DETECTIVES 
SERGEANTS 
MIDDLE LEVEL COMMAND OFFICERS 



6: 
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PREDICTOR SCALE PI 

Positively 

item Scored Response 

L I often act without thinking. False 

2. It doesn't bother me to put aside what I have been doing without 
finishing it. True 

3. I can honestly say that I do not mind paying my taxes because I feel 

that's one of the things I can do for what I get from the community. True 

4. I daydream very little. False 

PREDICTOR SCALE PII 

Positively 

Item Scored Response 

1. A person who doesn't vote is not a good citizen. True 

2. In a group of people I would not be embarrassed to be called 
upon to start a discussion or give an opinion about something I know 

well. True 

3. I have a tendency to give up easily when I nieet difficult problems. False 

PREDICTOR SCALE PHI 

Positively 

Item Scored Response 

1. Governor of a state Like 

2. Detective stories ^^^^ 

3. Inside work Dislike 

4. Minding your own business in a conflict situation Dislike 

^ , PREDICTOR SCALE PIV 

Item 

1. As a youngster, how often were you a leader in your group of 
friends? 

1. always 

2. frcquentiy } POSITIVELY WEIGHTED 

3. occasionally 

4. seldom or never 

5. was not a member of a group } NEGATIVELY WEIGHTED 

6. can't remember 

2. How sensitive have you been to criticism? 

1 . much more sensitive than most \ 

2. more sensitive than most \ POSITIVELY WEIGHTED 

3. about as sensitive as most j 

4. less sensitive than most \ NEGATIVELY WEIGHTED 

5. much less sensitive than most j 

3. aimbing along the edge of a precipice "Like" is positively weighted 

4. Directing traffic at a street comer "Like" is positively weighted 

PREDICTOR SCALE DI 

Item 

1, What did you like best about high school? 

1. the chance to get a high school diploma NEGATIVELY WEIGHTED 



I 

I 
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2. the activities in which you could participate 

3. the friends you made 

4. the things you learned 
2. How important is it to you to work on a job where 

you can be friends with your co*workers and spend 
time talking to them? 

1. very little importance ) 

2. low importance / 

3. fairly important ^ 

4. high importance j 

5. extreme importance NEGATIVELY WEIGHTED 



POSITIVELY WEIGHTED 



POSITIVELY WEIGHTED 



NOT WEIGHTED 



PREDICTOR SCALE DII 



Item 



1. I very much dislike making decisions when there is not enough 
available information. 

2. There is something wrong with a person who cannot take orders 
without getting angry and resentful. 

3. How many close relatives (parent, grandparent, uncle, brother) 
do you have who have been policemen? 

1. none NEGAll VELY WEIGHTED 

2. 1-2 1 

3. 3-5 [ POSITIVELY WEIGHTED 

4. 6 or more 1 

PREDICTOR SCALE SI 
Item 

1 . A patrolman on your shift has a drinking problem that is harming 
his performance, although as far as you know he has never come 
to work drunk or had a drink while on duty. You would: 
BEST 1. try to find out what his personal problems are 

to see why he is drinking. 
WORST 2. discuss it with his other supervisors. 

3. warn him that if he ever seems at dl under the 
influence, you will take disciplinary action. 

4. let it go since you don't have any evidence that 
he is drunk on duty. 

5. discuss it with your supervisor. 

2. While off duty you are involved in a minor traffic accident. The 
patrolman at the scene is handling the situation inconecUy. You 
would: 

BEST 1. correct the patrolman. 

2. speak to his sergeant about it the ne);t day. 

ILWORST 3. correct the patrolman and also mention it to the 

patrolman's sergeant the ner^t day. 

4. Ignore the situation because it was only a minor 
traffic accident. 

5. say nothing about it to the patrolman's sergeant, 
but inform the captain. 

3. During a spot inspection of a patrol car you find a private rifle one 
patrolman is carrying in t^e trunk. You would: 

BE^*T 1. confiscate the rifle. 



Positively 
Scored Response 

True 

True 



Positively 
Scored Response 



Choose 5 as- 
BEST 



Choose 3 as 
BEST 
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.WORST 2. !ell the officer to take it home when he goes off 

duty. Choose any 

3. let it go since this officer always uses good answer but 1 as 
judgment and might need the rifle on his patrol. BEST 

4. refer the incident to the lieutenant and record 
it in the patrolman's file. 



PREDICTOR SCALE SII 



Item 



1. How much did you enjoy the work you did on any puit-time jobs you have held? 

1. very much POSITIVE 

2. much NOT WEIGHTED 

3. somewhat NOT WEIGHTED 

4. slightly NEGATIVE 

5. not at all NOT WEIGHTED 

6. never had a part-time job NOT WEIGHTED 

2. Using your own interpretation of what success means, do you feel you have been 
successful to this point in your life? 

I POSITIVELY WEIGHTED 

2. partly f 

3. no \ 

4. not sure [ NEGATIVELY WEIGHTED 

5. not old enough yet to say ) 

3. The only reason a person works is to allow him/her to enjoy free time more. 

1. definitely agree \ NEGATIVELY WEIGHTED 

2. probably agree | 

3. not sure > 

4. probably disagree | POSITIVELY WEIGHTED 

5. definitely disaeree ; 



PREDICTOR SCALE CI 

Positively*, 

Item S<vred Response 

1. I have often lost out on things because I couldr/t make up my 

mind soon enough. False 

2. Many people will lie if it is to their advantage and they 

have the chance. False 

3. How far did you go in school? 

1 . 8th grade or less \ NEGATIVELY WEIGHTED 

2. 9-11 years > i 

3. graduated from high school) ^ 

4. 1-4 ycais of college \ POSITIVELY WEIGHTED 

5. bachelor s degree f 

6. other NOT WEIGHTED 

4. How much did your parents emphasize success and getting 
ahead to you? 

1. constantly POSmVELY WSIGHTTED 
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2. frequently 

3. now and then 

4. rarely 

5. never 



NEGATIVELY WEIGHTED 



PREDICTOR SCALE CII 



I POSITIVELY WEIGHTED 



hem 

1. When you were a high school student were you: 

1 . one of the most active students \ 

2. more active than most students 

3. about as active as most students NOT WEIGHTED 

4. not quite as active as most students NEGAJIVELY WEIGHTED 

2. What has been your experierv:e with people? 

1. there is a lot of good in all people POSITIVELY WEIGHTED 

2. there is some good in most people NOT WEIGHTED 

3. people are about as good as they have to be . . . NEGATIVELY WEIGHTED 

4. a surprising number of people are mean 
and dishonest > NOT WEIGHTED 

5. most people are just no good 



) ce 

1 



3. When you were in high school, what positions 
d»^. you hold? 

Positively Weighted Response 
. chairman of an important student committee 

editor of a publication 
. member of the student council 
. captain of an athletic team 

PREDICTOR SCALE CIH 
hem 

One of your best sergeants is typically 10 to 15 minutes late for work. You would: 

^^BEST 1. dock his overtime a specified amount every day he is late. 

— ^WORST 2. keep a daily record, and report it in his personnel file. 

3. ignore it because he is so competent die other <^ven hours and 
forty-five minutes. 

Highest Positive ; , ^ Highest Negative 

Combination Combination 

Choose 3 as WORST and Choose 3 as BEST and either 

either I or 2 as BEST 1 or 2 as WORST 

An officer shows up for work smelling of liquor, but obviously not drunk. You wovld: 
BEST 1. send him home and mark him "sick." 

2. give him plenty of coffee, make sure he is sober, and send him on 
WORST patrol. 

3. reassign him for the day to station duty. 

4. send him home and require that he make it up on one of his off days. 
Highest Positive Highest Negative 

Combination Combination \ 

Choose 4 as BEST and Choose 2 as BEST and 

2 as WORST 4 as WORST 
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PREDICTOR SCALE CIV 



Item 

1 . On the average, how many hours a Week did you work on a part-time job in high 
school? 

1. none NEGATIVELY WEilGHTED 

2. 1^ NOT WEIGHTED 

3. 5-10 NOT WEIGHTED 

4. 11-15 POSITIVELY WLIGHTED 

5. 16 or more NOT WEIGHTED 

2. Some people are completely involved in their job— they are a'^^Olt^d in it night 
and day. For other people, their job is simply one of several interests. 
How involved do you usuaJ.ly feel in a job? 

X. 1. very little involved — my other interests ) WEIGHTED 
are more absorbing / 

2. slightly involved / 

3. moderately involved-my job and oth< r ) NEGATIVELY WEIGITTED 
interests are equally absorbing to me } 

4. strongly involved 

5. very strongly involved— my work is the \ POSITIVELY WEIGHTED 
most absorbing interest in my life 



PREDICTOR SCALE CV 



hem 

tt 

1. You, as lieutenant, want to assess the training needs of your 
patrolmen. You would: 

BEST 1. ask tlie pt '^'men what thty need to know 

be'cter. 

WORST 2. ask both the patulmen and the sergeants. 

3. look over the reports and performance reviews 
of the men to pinpoint their weaknesses. 

4. plan a general review of the academy course, 
since all the men could use a refresher. 

5. consult with the judges and district attorney 
to learn how to improve your conviction rate. 

2. A call comes in for assistance at the scene of a gang fight 
in a ghetto area. The report says that one gang is pre- 
dominantly Chicano and has about 15 members, and the other 
gang is predominantly black and has about 20 nnembers. 
You, the captain, would: 



Positively 
Scored Response 



Choose 4 as 
WORST 



Choose 1 or 3 as 
BEST 



. BEST 1. dispatch 3 squads to the area. 

. 2. dispatch 2 squads to the scene, plus the 
. WORST ' lieutenant, because he needs experience in such 

situations. If 3 is chosen as. 

.3. dispatch two squads and rush to the scene WORST^itis , 
yourself to coordinate the efforts. negatively 

4. dispatch one squad, the lieutenant, and yourself weighted - 
to the scene. i ' 

5. send the sergeant and all available precinct 
squads. 



APPENDIX H 

VALIDITIES FOR PREDICTOR SCALES AGAINST 
CRITERION DIMENSIONS FOR TOTAL 
SAMPLES AND SEPARATELY BY CITY 
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Table 1 



Validities* for Predictor Scales of the Patrol Officer Career Index for Total Sample and Separately by City'*'* (Whites 

Only) 



Predictor Scale 



Criterion Dimension 

Crime Force Teamwork Overall Random 



PI 



Total (502) 



18 



40 



13 



24 



01 



Minneapolis (155) 
Portland (47-49) 
Dcs Moines (87-^*1) 
Cincinnati (92-93) 
^iiami (50) 

Washington. D. C. (60-62) 



17 
27 
00 
20 
22 
20 



43 
46 
39 
33 
00 
46 



17 
06 
05 
03 
01 
-09 



25 
28 
11 
17 
03 
32 



-05 
-33 
06 
02 
22 
-04 



Pll 



Total (452) 

Minneapolis (153) 
Portland (46-48) 
Des Moines (84-88) 
Cincinnati (92-93) 
Miami (49) 

Washington, D. C. (60-62) 
Pill 



29 

26 
43 
09 
24 
18 
36 



14 

18 

35 
18 
11 

-11 

32 



32 

28 
22 
08 
06 
16 
28 



37 

32 
41 
10 
22 
21 
49 



03 

-10 
-19 
-01 
06 
18 
-16 



Total (528) 

Minneapolis (152) 
Portland (49-51) 
DCS Moines (72-74) 
Cincinnati (89-90) 
Miami (52) 

Washington, D. C. (55-57) 
PIV 



41 

42 
40 
39 
40 

25 
03 



11 

-01 
17 
17 
14 
-14 
-19 



28 

15 
20 
07 
23 
09 
51 



42 

37 
24 
32 
38 
34 
24 



04 

11 

-09 
02 
03 
22 

-06 



Total (372) 



37 



06 



54 



48 



03 



Minneapolis (139) 
Portland (46-47) 
Des Moines (72-74) 
Cincinnati (91-92) 
Miami (53) 

Washington, D. C. (56-58) 



38 
63 
22 
38 
38 
03 



03 
27- 
07 
18 
-02 
-19 



48 
52 
09 
43 
26 
51 



43 
43 
24 
43 
35 
24 



*Decimals omiiied. 

••N» viiy according lo criietion dimeiuion. The ranges of sampk sizes are shown wjihin the paremhetes. 



-06 
-05 
06 
02 
12 
-06 
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Tablk 2 

Validities* for Predictor Scales of the Detective Career Index for Total Sample and Separately by City** (Whites Only) 

Criterion Dimension 

Predictor Scale Investigation Integrity Reporting Overa^! Random 

Dl 

Total (245) 52 23 58 59 00 

Minneapolis (44) 69 4^ 61 76 -02 

Portland (42) 41 -03 55 57 -07 

Cincinnati (39-41) 66 40 53 65 - 09 

Washington, D. C. (36-42) 37 06 47 64 ' 12 

San Diego (52) 41 13 40 42 01 
Des Mohiss, Tucson, 

Albuquerque (49) 58 50 61 70 -03 
Dl! 

Total(263) 11 62 26 17 -09 

Minneapolis (40) 13 50 26 21 -21 

Portland (42) 03 75 14 35 -27 

Cincinnati (20-21) -15 12 28 -16 44 

Washington. D. C. (39-45) 31 49 03 19 -13 

San Diego (39) 03 -11 '27 05 -14 
Des Moines, Tucson, 

Albuquerque (52) 06 42 12 08 00 



'Decimals otnilled. 

**Nt vary acconling to criterion dimcnMon. The ranges of simple sizes are shown within the parentheses. 
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Table 3 



Validities* for Predictor Scales of the Sergeant 



Career Index for Total Sample and Separately by City** (Whites Only) 



Predictor Scale 



Training 



Supervision 



Criterion Dimension 



Inspection 



Overall 



Random 



SI 



Total (271) 



Minneapolis (38-39) 
DCS Moines (37-39) 
Cincinnati (61) 
Miami (42-^) 
Washington. D. C. (55) 
San Diego (41-42) 



S!l 



Total (286) 



Minneapolis (37-38) 
DCS Moines (31-33) 
Cincinnati (63-64) 
Miami (42-45) 
Washington. D. C: (57) 
San Diego (42) 



45 

56 
28 
36 
50 
38 
56 



54 

53 
36 
41 
73 
58 
44 



55 

62 
52 
35 
61 
50 
45 



37 

28 
20 
41 
54 
43 
35 



48 

47 

31 

25' 

58 

37 

56 



40 

45 
42 
28 
57 

37 
31 



59 

64 
55 
47 
68 
58 
54 



54 

48 
48 
51 
62 
62 
52 



00 

-01 
20 
-09 
-25 
21 
03 



06 

-24 
32 

-04 
06 
30 

-08 



•Decinwls omircd. -n,. ,.«o*.v of s«mDle sizcv juc »h<r*n within ihc parenthese!.. 

••N* v«fy accofding lo critoioo dimcn^on. The ranges of simple sizci. »ri^ 
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Table 4 

Valimes^for Predictor Scales of uu Middle Command Career Inde. for Total Sample. nd Separately ty City** 

(Whites Only) ■ 



Predictor Scale 



Adminis- 
tration 



Communi- 
cations 



Criterion Dioiension 
Personnel 



Dedication 



Random 



l^nneapolis (27) 
Portland (17) 
bes Moines (19) 
Cincinnati (22-24) 
Miami (28) 

Washington, D. C. (41) 
San Diego (27-28) 



Minneqwlis (28) 
Portland (18) 
Des Moines (19) 
Cincinnati (22-24) 
•Miami (28) 
Washington. D. C. (43) 
San Diego (30) 



Minneapolis (25) 
Portland (18) 
Des Moines (20) 
Cincinnati (21-23) 
Miami (29) 

Washington. D. C. (39) 
San Diego (30) 



Total (131) 37 « 

^ . ^ 74 38 61 -08 

Minneapolis (25) 32 

Portland (17) . 59 ' " 02 35 00 

59 29 66 -50 

298 
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Criterion Dimension 

Adminis- Communi- 



Predictor Scale 


tration 


cations 


Personnel 


Dedication 


Overall 


Random 


De.s Moines (19) 


08 


21 


-18 


40 


20 


00 


Cincinnati (20-22) 




69 


88 


71 


86 


-08 


Miami (27) 


43' 


50 


78 


73 


75 


-08 


Washington, D. C. (40) 


33 


31 


62 


35 


46 


"04 


San Diego (30) 


41 


49 


80 


03 


68 


04 



*DccifnuK omilted. 

••N\ vaf> w;canling lo criierum dimen\iofl. The ranges of sample li/ei are showa wiihifl ihc purentheses. 
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